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1. INTRODUCTION 


1.1 BACKGROUND 

in Phases I, II, and III of the Large Area Crop Inventory Experiment (LACIE), 
Classification and Mensuration Subsystem (CAMS) analysts generated acreage 
estimates of all small grains and confusion crops that were spectrally simi- 
lar to small grains when viewed on imagery acquired by the Land Satellite 
(Landsat). Sample segment acreage estimates were sent to the Crop Assess- 
ment Subsystem (CAS) for aggregation. Confusion crop ratios were applied 
to determine wheat acreage estimates.^ 

A LACIE objective was to estimate a segment's wheat proportion using Landsat 
imagery and thus to reduce the dependence on historical ratios. A direct 
wheat procedure, developed utilizing LACIE Phase II North Dakota blind site 
ground- truth data, was implemented during LACIE Phase III North Dakota opera- 
tions. A spring wheat estimate separate from other spring small grains was 
determined and passed to CAS for all processable LACIE Phase III North Dakota 
segments . 

1.2 OBJECTIVES 

This paper, a documentation of the LACIE Phase III direct whv^at procedure and 
the subsequent study of the separation of spring small grains, accomplishes 
the following objectives: 

1. Explanation of the LACIE Phase III direct wheat procedure. 

2. Statistical evaluation and analysis of the procedure. 

3. Summary of the effectiveness of the procedure. 

4. Establishment of spring small grain separation parameters. 

5. Establishment of an optimal crop calendar development stage for separa- 
tion. 

6. Improvement and refinement of separation procedures. 


An explanation of the types of ratios used in LACIE Phases I, II, and III is 
given in "The Crop Assessment Subsystem - System Implementation and Approaches 
Used for the Generation of Crop Production Reports" bv W. E. McAllum ct al . , 
to be published, 
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2. DATA SET 


2.1 LACIE PHASE III BLIND SITES IN NORTH DAKOTA 

The blind sites represent a random sample drawn from the operational segment 
data base at a one-third ratio arrayed by the number of LACIE segments in the 
state, crop reporting district (CRD), and county. Aerial color-infrared 
photographs (scale of 1 :24 000) processed by personr.-l at the Johnson Space 
Center (JSC), ground-truth field data surveyed by the county executive direc- 
tor of the Agricultural Stabilization and Conservation Service of the U.S. 
Department of Agriculture (USDA), ground-truth field overlays for the color- 
infrared photographs, and a universal -format ground-truth file registered to 
the Landsat imagery are available for the majority of the blind sites. 

The 18 of 27 North Dakota blind sites selected for study and evaluation met 
the following criteria: 

1. The blind sites were located in North Dakota. 

2. Aerial col or- infrared photographs were available. 

3. Landsat data were acquired. 

4. Field ground-truth survey )aas available. 

5. Segment received a satisfactory CAMS acreage estimate. (See reference 9 
for explanation of a satisfactory estimate.) 

6. Each site contained less than 500 fields. 

The blind site segments and the corresponding county, CRD, agrophysical unit 
(APU), and Analyst Interpretation (AI) Keys' partition comprising the data 
set are listed in table 1; and their locations are shown on the North Dakota 
map (fig. 1). 

2.2 DESCRIPTION OF NORTH DAKOTA 

North Dakota, the heart of the northern Great Plains spring wheat region, has 
fertile soils and dominantly smooth topography favorable for agriculture. The 
variety of crops that can be cultivated is limited by the low annual rainfall 
and the short growing season. Dryland spring wheat production dominates the 
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TABLE 1 .- NORTH DAKOTA BLIND SITE SEGf^ENT INFORMATION 
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agriculture of the region. Figure 2 (ref. 1) shows the geographic regions of 
North Dakota as described in section 2.2.1, and figure 3 (ref. 2) gives the 
mean annual precipitation. Section 2.2.2 describes the soils of the region, 
and section 2.3 discusses agricultural practices in the state. 

2.2.1 GEOGRAPHIC REGIONS 

2. 2. 1.1 Dark Brown Glaciated Plain 

Area 1, a dark brown glaciated plain, is used primarily as farmland and ranch- 
land, with slightly more than half of the acreage devoted to cropland. Spring 
wheat (the most important crop), feed grains, forage crops, and some flax are 
grown in tho area. Native grasses grow on the more sloping land. Water con- 
servation farming methods are practiced as irrigated cropland is confined to 
a narrow strip along the Missouri River. 

Increasing in elevation from the southeast to the northwest, this gently roll- 
ing glaciated plain includes some areas of kames and moraines. The major 
valleys are bordered by steep slopes and badlands. 

The average annual precipitation is 38 to 46 centimeters (15 to 18 inches), 
with the majority of the rain falling during the growing season. The average 
freeze-free period is 104 to 140 days. 

f 

2. 2. 1.2 Rolling Soft Shale Plain 

The agriculture of ar<^.: 2, a rolling soft-shale plain, is a combination of 
cash grain farming and livestock production. The more gently sloping land is 
dry- farmed. Rangeland, about three-fifths of the area, is in native grasses 
and shrubs. Narrow strips along the Missouri River and its tributaries are 
irrigated. The major crops in this area are wheat, feed grains, hay, and 
pasture. 

The area is a moderately dissected rolling plain predominantly underlain by 
calcareous shales and sandstones. In some places, the major stream valleys 
are bordered by strongly dissected areas of sharp local relief, steep slopes. 



Figure 2.- Geographic regions of North Dakota. 
(From ref. ] . ) 
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or badland topography. The northern and eastern fringes have been glacially 
modified. Farmers use moisture-conserving cultivation methods. 

The average annual precipitation, increasing from west to east, is 33 to 
48 centimeters (13 to 19 inches). The spring to midsummer months are the 
wettest. The average freeze-free period is 110 to 135 days. 

2. 2. 1.3 Black Glaciated Plain 

Area 3, a black glaciated plain, is used primarily as farmland and ranchland. 
Three-fourths of the land is devoted to cropland. Wheat is the principal 
crop, but other small grains, feed grains, hay, and flax are also cultivated. 
Native grasses grow on the more sloping, thinner soils. Narrow strips of wet 
soils on the flood plains are wooded. Agriculture is dependent on the erratic 
precipitation because little irrigation is practiced. 

This area is a nearly level glacial plain bordered by rolling morainic hills 
along its western edge. Local relief is low throughout most of the area. 

The average annual precipitation of 36 to 51 centimeters (14 to 20 inches) 
fluctuates widely from year to year. Late spring to early autumn months 
are typically the wettest times of year. The average freeze-free period, 
increasing from north to south, is 100 to 145 days. 

2. 2. 1.4 Red River Valley 

In area 4, the Red River Valley, farms and ranches occupy most of the terrain. 
The poorer soils in the northeast, covering 10 percent of the area, are 
wooded. Three-fourths of the area is cropland. Spring wheat, potatoes, 
sugar beets, and corn are the most important crops. in area 4. Feed grains 
and forage for dairy cattle are also. principal crops. The more sloping. land 
on the west is rangeland. Normally, -there is sufficient moisture for crops, 
but wide fluctuations from year to year create supply uncertainties. Drain- 
age systems are required in many of the flatter sections. Water management 
is a problem in this area. 
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This area is a nearly level glacial lake plain decreasing in elevation from 
south to north. 

Most of the average annual precipitation of 48 to 56 centimeters (19 to 
22 inches) falls between late spring and early autumn. The average freeze- 
free period is 105 to 135 days. 

2. 2. 1.5 Northern Rolling High Plains 

Most of area 5, the northern rolling high plains, is ranchland with a very 
small percentage planted to dry-farmed wheat. Native shrubs and grasses 
prevail on the rangeland. Rainfall is the principal source of moisture for 
agriculture; therefore, the limited water supplies must be well managed. 

The area is a dissected plain with slopes ranging from rolling to steep. 

The average annual precipitation of 30 to 41 centimeters (12 to 16 inches) 
fluctuates widely from year to year, with most of the precipitation occurring 
in the spring and early autumn. 

2.2.2 SOILS 

Eastern North Dakota is dominated by Udic Borolls soils that are moister 
than average for Borolls, whereas Typic Borolls with average moisture occupy 
the western portion of the state. Borolls soils have mean annual soil 
temperatures of less than 47° F (8° C). The eastern soils are nearly black 
in color and fine loamy to clayey in texture; western soils are dark brown to 
nearly black in color and loamy to clayey in texture (ref. 3). The soils of 
North Dakota are mapped in figure 4 (ref. 4). 

2.3 AGRICULTURAL PRACTICES 

Limited precipitation as well as widely fluctuating annual precipitation 
controls the cropping practices of the state. Dryland farming of small 
grains prevails; irrigation is confined mainly to narrow bands along rivers 
and streams. Generally, the cropninn practices can be discussed in tv.'O 
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BLACK SOILS OF SUBHUMID GRASSLAND 

Nearly level to gently rolling soils with thick black surface layer 
(Chernozem) and associated soils with very limy subsoil (calcium 
carbonate Snionchak), with claypan subsoil (Solonetz), or with wet 
soils (humic gley and planosol): Inams and clay loams, sandy loams 
and loams with sandy substrata, and sandy loams and loams with 
sandy and gravelly substrata 

Rolling soils with thick black surface layer (Chernozem) and asso- 
ciated steeply sloping soils with thin surface layer (regosol): loams 




DARK BROWN SOli.S OF SEMIARID GRASSLAND 



Nearly level to gently rolling soils with thick dark brown surface 
layer (Chestnut) and associated soils with claypan subsoil (Solonetz) 
or steeply sloping soils with thin surface layer (regosol and 
lithosol): loams and clay loams, sandy loams and loams, and sandy 

loams and loams with sandy and gravelly substrata 

Rolling soils with thick dark brown surface layer (Chestnut) and 
associated steeply sloping soils with thin surface layer (regosol): 
loams 


SOILS OF SUBHUMID WOODLAND 



Undulating to rolling soils with gray surface layer (gray wooded) 
and associated soils with thick black surface layer (Chernozem); 
clay loams and clays 


CLAY SOILS OF GLACIAL LAKE PLAINS 
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Nearly level soils with thick black surface layer (grumusol) 


VERY LIMY SOILS OF SUBHUMID GRASSLAND 




Nearly level to undulating soils with very limy subsoil (calcium 
carbonate Solonchak) and associated soils with thick black surface 
layer (Chernozem), wet soils (planosol), or saline soils (Solonchak); 
loams, clay loams, and sandy loams 

Saline clay loams and loams 


ALKALI SOILS 


Nearly level alkali soils with claypan subsoil (Solonetz) and asso- 
ciated nonalkali soils with thick surface layer (Chestnut and 
Chernozem); loams and clay loams 


SOILS OF STREAM VALLEYS 

Nearly level soils on bottomlands (alluvial), gently sloping soils on 
Me-ate i l iBl alluvial pans (alluvial and Chernozem), and steeply sloping soils 
(regosols); loams, sandy loams, and clay loams 


SOILS ON STEEP SLOPES 




Hilly and steeply sloping soils with thin surface layer (regosol and 
lithosol) and associated soils with thick surface layer (Chernozem 
and Chestnut) or with claypan subsoil (Solonetz): rough broken 
land 

Hilly and steep land 
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sections; those practices typical of eastern North Dakota and those typical 
of western North Dakota. 

Generally, small grain yields of eastern North Dakota are higher than those 
of the western part of the state. This trend is a result of the greater 
precipitation and more fertile soil in the east than in the west. Fields 
are planted in block dimensions and occasionally in strips. Crop rotation 
(e.g., a spring small grain grown for 3 to 5 years followed by a year of 
fallow or by the planting of another crop) is common. Historical land-use 
patterns affect current cropping practices. 

Fields of western North Dakota are planted in combination of strip and block 
dimensions although strip fields predominate. Spring small grains are 
planted on summer fallowed land because continuous cropping leads to low-yield 
situations, thus increasing the risk of crop failure. Approximately half of 
the area is rangeland of native grasses and shrubs. Seeding and improving 
native range are common practices in the western portion of the state 
(ref. 1). 

Table 2 illustrates the extent of summer fallowing in North Dakota from 1975 
to 1977; the percentage of fallowed land increases from east to west and from 
south to north. As indicated in the table, fallowed barley acreage was nearly 
half that of the spring wheats (refs. 5 and 6). 

Table 3 lists the percentage of cropland by county and the percentage of 
cropland planted to spring small grains in 1974 for the blind site counties 
(ref. 7). This table shows that small grains represent a significant portion 
of the agricultural area of the blind site counties. 
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TABLE 3.- 1974 CROPLAND STATISTICS FOR NORTH 
DAKOTA BLIND SITE COUNTIES 

[From ref. 7] 


County 

Land in county devoted 
to crops, % 

Cropland planted 
to spring small grains. % 

Barnes 

84 

59 

Bowman 

48 

42 

Cavalier 

80 

63 

Dunn 

35 

40 

Grand Forks 

83 

56 

Hettinger 

83 

46 

McIntosh 

67 

45 

Mercer 

46 

44 

Mountrail 

61 

44 

Ramsey 

82 

52 

Renville 

77 

54 

Richland 

82 

46 

Sargent 

76 

44 

Sheridan 

59 

50 

Stark 

64 

42 

Stutsman 

67 

58 

Walsh 

85 

60 

Ward 

73 

50 
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3. DIRECT WHEAT PROCEDURE (INITIAL STUDY) 


3.1 DESCRIPTION 

3.1.1 SEPARATION GUIDELINES 

General separation guidelines, based on established agronomic practices and 
crop development patterns, were used in assisting the analysts' decisions on 
separating wheat from other small grains. Although the spectral reflectance 
patterns cf all small grains are similar, the following general differences 
can be noted: 

• Barley is generally planted after wheat. 

• Barley tends to green up sooner than spring wheat and tends to obtain 
higher levels. 

• Barley turns and matures earlier than wheat. 

• Barley tends to be brighter than wheat after heading. 

• Rye is greener than wheat. 

• Oats are not as green as wheat and may mature earlier than wheat. 

Figure 5 is a sample plot of small grains' green number growth patterns that 
was intended to provide general guidance in separation decisions. The data 
on the plot were derived from nine LACIE Phase II North Dakota blind sites. 

A field was assumed to be spring wheat unless it could be shown that the 
field was nonwheat small grains. Figure 6 gives the flexible decision logic 
that was followed in determining wheat/small grains separation. 

3.1.2 PROCEDURE FOR SEPAflATING WHEAT FROM OTHER SMALL GRAINS 

Listed below is the procedure followed by the analysts in separating wheat 
from other small grains during LACIE Phase III operations. 

1. Evaluated the bias-corrected estimate (BCE) for small grains to determine 
whether it was satisfactory. The separation procedure was not applied 

to the segments with an unsatisfactory BCE. 

2. Studied the 1975 county grain production maps given in figure 7 (ref. 8) 
to gain an understanding of the relative importance and ranking of each 
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^X'flELD InVv. 
^CLUSTER THAT 
DOMINANTLY ONE CLASS 
(E.G., WHEAT, NONWHEAT^ 
SMALL GRAINS) 


IN A WHEAT 
CLUSTER 


IN A NONWHEAT 
SMALL GRAINS 
CLUSTER 


NONWHEAT SHALL GRAINS 


Figure 6.- Decision logic for separating wheat from other small grains. 

(D. R. Thompson and J. D. O'Connell, personal co.T,municati on. ) 
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ALL IWEAT, 1975 • Production by Counties, bu 
(R»nk Of First 10 Counties Shown) 



BARLEY, 1975 Production by foimtU'S, bu 
(Rank of First 10 Counties Shnwni 



Under 250 000 500 000 - 2 499 999 

CH 250 000 - 499 999 2 500 000 and over 


RYE, 1975 - Production by Counties, bu 
(Rank of First 10 Counties Shown) 



Fioure 7.— Production of wheat and 

(From 


'fWiGINAL PAGE (s 
POOR qoaLTY 



small grain in the county in which the segment was located. The 9- by 
9-inch full frames were used to check the relationship between the 
segment and county. (Reference 9 amplifies use of the Landsat full 
frames.) 

3 Looked at the crop calendar (fig. 8) produced by the Yield Estimation 
Subsystem (YES) and the wheat/small grains separation guidelines to 
formulate some expected general spectral characteristics (greenness on 
fig. 5 and brightness) for each small grain. 

4. Looked at the spectral plots of the base acquisition showing the classifier- 
identified picture elements (pixels) of small and nonsmall grains (example 
shown in fig. 9 for four acquisition dates). Using the knowledge of the 
historical importance of each small grain in the county and the expected 
relative greenness and brightness position of each small grain, lines 

were drawn on the spectral plot to separate classes of small grains. 

Labeled these small grain classes on the spectral plot (i.e., wheat, 
barley, oats, etc.) within the boundary lines drawn. 

5. Located each of the small grain's pixels (using greenness and brightness 
values from the spectral plot) in table 4, the listing ordered by dot 
number. 

6. Indicated for each pixel classified as a small grain(s) in the listing, 
to which grain class (wheat, W; barley, B; oats, 0; rye, R; etc. )pre- 
viously indicated on the spectral plot that the specific pixel belonged. 

Put a symbol (W, B, 0, R) to the right of the brightness value of that 
pixel in the table 4 base acquisition listing. 

7. Determined the total number of pixels classified as S in the fourth 
column of table 4. 

8. Tallied the number of S pixels in each grain class (W, B, 0, R). 

9. Determined the proportion of classified small grains' pixels for the 
wheat (W) class. 

Number of $ pixels in the wheat class 
Total' number pixels classified as S 
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Figure 8.- Nominal crop calendar. (Produced by the YES.) 
























(a) Acquisition date, 77120. 

Figure 9.- Scatter plots of classified symbols for segment 1475 (Richland County). 
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(b) Acquisition date, 77157. 
Figure 9.~ Continued. 


•camsiTion • 77175 ' ' ••• ' cussifieo sy^imh. 






(c) Acquisition date, 77175. 
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(d) Acquisition date, 77210. 
Figure 9.— Concluded. 
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Green number. 



TABLE 4.- Continued 
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Brightness value. 















Total number of S pixels labeled W, B, and 0 
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10. Determined the percentage of spring wheat for the segment. 

(Pyy)(^Sgj,^) « percentage of spring wheat 

where 

Py, “ proportion of spring wheat 
^BCE " hias-corrected estimate for grains 

11. Subtracted the percentage of spring wheat from the BCE to obtain the 
percentage of other spring small grains in the segment. 

12. Recorded the proportions of spring wheat and other small grains on the 
CAMS evaluation form and Porta-punch cards. 

13. Recorded all other information in the necessary places, put packet 
contents together in proper manner, and turned packet over to the spring 
wheat/small grains coordinator (D. R. Thompson and J. D. O'Connell, per- 
sonal communication.) 

3.1.3 DEVIATIONS FROM THE PROCEDURE 

The analysts deviated from the established procedure on points 4 and 6. In 
reference to point 4, base acquisition was not defined; therefore, wheat was 
separated from other small grains on the acquisition that appeared to show 
separability. The green number growth plot of the small grains (fig. 5), the 
separation guidelines, the crop calendar (fig. 8), and scatter plots (fig. 9) 
provided the bases for determining the acquisition to use in separation. 

Point 6 directed the analyst to label all pixels classified as being small 
grains with W, B, 0, or R. The dots classified S that the analyst determined 
by interpretation of the imagery as being nonsmall grains were eliminated 
from the proportion. North Dakota was processed as a spring grain state; and 
because rye is primarily a winter grain, it was classified as nonsmall grain. 
No rye was labeled. 


3.1.4 IMPLEMENTATION OF THE PROCEDURE 


Segment 1475 (Richland County) shows how the direct wheat procedure was 
implemented. Using Procedure 1 as described in reference 9, the analyst: 
obtained a satisfactory spring grains' BCE of 36 percent. 

North Dakota crop acreage data were removed from the operational segment 
packets to eliminate analyst bias in separating the grains. Production maps 
(fig. 7) were provided as a guide on the importance of the grains in the 
county. Thus, the figure indicates that in 1975, Richland County farmers 
produced 3 to 5.5 million bushels of wheat, 0.5 to 2.5 million bushels of 
barley, and 0.7 to 1 million bushels of oats. 

The full-frame data (CAMS 9- by 9-inch files) were checked to ascertain how 
representative the segment is of the county. In this example, the segment 
represents the southwest part of the county only. 

The crop calendar (fig. 8) was consulted to determine crop development stage. 
The YES computed an adjustment to the nominal wheat crop calendar. Table 5 
summarizes the crop calendar information available to the analyst. 

After reviewing the separation guidelines, the green number growth patterns 
for all acquisition dates (fig. 5), the crop calendar information, and the 
scatter plots (fig. 9), the analyst determined which acquisition displayed 
the most separability of the spring small grains. Decision lines [fig. 9(c)] 
were drawn on the chosen scatter plot where a natural break in the data 
appeared. The lines separate wheat from barley and oats. 

Using table 4, the analyst located each of the pixels classified S (spring 
small grains) on figure 9 (c), and the appropriate label {U, B, or 0) was 
written to the right of the brightness value for the separation acquisition. 
The analyst verified questionable S-classified pixels with the imagery and 
omitted those pixels interpreted as nonsmall grains. The number of S pixels 
labeled W, B, or 0 were tallied (59) and divided by the total number of W 
pixels (33). (See last page of table 4). The BCE of the small grains 
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TABLE 5.- CROP DEVELOPMENT STAGES FOR SEGMENT 1475 
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(36 percent) was multiplied by the proportion of spring wheat (0.5593) to 
achieve a direct wheat estimate (20.1 percent spring wheat). The difference 
between the BCE and the wheat estimate is the percentage of other small grains 
(15.9 percent) in the segment. 

3.1.5 PROBLEMS ENCOUNTERED IN PROCEDURE IMPLEMENTATION 

The analyst, according to procedure, could apply separation labels only to 
those pixels classified S. Occasionally, a spring grain signature was classi- 
fied N (nonsmall grain) because the signature did not have a type 1 dot label 
or because the signature was in a mixed cluster and misclassified. That 
signature may have had an S-type two-dot label; but because of the N classi- 
fication, the analyst could not apply a separation label. The accuracy of 
the machine classification was very important in the direct wheat procedure. 

A poor acquisition history was a serious problem for 4 of the 18 blind sites 
in North Dakota (see appendix B). Adequate acquisition history is vital in 
obtaining the best possible small -grain estimate. In the subsequent study, 
the coverage during the heading to ripening stages was found to be critical 
in separation of barley from wheat and oats. Segment registration between 
acquisitions was critical to the correct labeling of border pixels; a sub- 
stantial error was related to misregistration and border pixels. 

3.1.6 USE OF THE PRODUCTION MAP IN THE PROCEDURE 

The production maps (fig. 7) were utilized as a guide to the importance of 
certain crops in a given county. The estimate determined in CAMS operations 
was a percentage of the total segment acreage rather than production (yield x 
acreage). Yield as related to total production is variable among different 
small grain crops as well as among counties for the same crop. During North 
Dakota segment processing, the assumption was made that these variances were 
not significant. 


Table 6 (refs. 7 and 8) lists examples of potentially misleading data for 
four counties (Barnes, Bowrian, Sargent, and Ward). A discussion of each 
county follows. 

1. Barnes County: Figure 7 shows that wheat and barley exceed the 
production category limit, but there is no indication that the wheat 
acreage is nearly three times that of barley. 

2. Bowman County: In 1975, 15 700 acres of winter wheat were harvested. 

Figure / does not relate this information. In North Dakota, winter grains 
are labeled non-spring small grains. The LACIE Phase III blind site 
grou, id-truth information for the Bowman County segment indicated that 

45 percent of the small grain dots wore winter wheat, 40 percent spring 
wheat, and 15 percent barley and oats. 

3. Sargent County: Barley and oats occupied approximately the same number 

of acres in 1975. The categories of 0.5 to 2.5 million bushels of barley 
and 1.0 to 1.5 million bushels of oats are misleading. 

4. Ward County: Oat production could be less than, equal to, or greater 
than barley production. Wheat production is probably much greater than 
oats, but an accurate, infonnative picture has not been made available. 

Specific crop acreages for a 5-year period, total agricultural acreage, and 
county acreage in conjunction with full-frame coverage best assist the 
analyst in determining crop importance in the segment to be worked. Appen- 
dix C provides additional acreage information. 

3 . 2 STATISTICAL EVALUATION AND ANALYSIS 

A statistical evaluation was made to determine the accuracy of the LACIE 
Phase III direct wheat procedure. The following questions were posed for 
evaluation. 

1. How accurately was the machine able to classify the 209 dots? (Table 7.) 

2 . How accurately were the analysts able to label spring wheat dots that 
were classified as small grains? (Table S.) 




3. How accurately were the analysts able to label spring wheat dots? 

(Table 9.) 

4. The direct wheat procedure assumed that the ratio of wheat to small 
grains was the same for those pixels classified as small grains as it 
was for those pixels classified as nonsmall grains. To what extent was 
this assumption tenable? {Table 10.) 

5. Were the accuracies obtained for discriminating wheat from other small 
grains greater than those from random chance? (Table 11.) 

6. How well did the wheat proportion estimates agree with the ground-truth 
wheat proportions? (D. T. Register, personal communication, Apr. 1978.) 
(Table 12.) 

The answers to these questions as quantified in tables 7 through 12 are 
discussed in section 3.2.3. The results are given for each CRD, AI keys 
partition, final separation acquisition, APU, and overall for the state. 

3.2.1 DATA SET 

Two sets of ground truth for the 209 dots were available for evaluation. The 
Accuracy Assessment (AA) section prepared universal format ground-truth files 
registered to the Landsat imagery for acceptable segments (as defined in 
section 2.1). The crop codes on the ground-truth files corresponding to the 
209 pixels on the Landsat imagery comprised a set of ground-truth labels used 
for comparison. See reference 10 for documentation of ground-truth file 
creation. 

A second set of ground-truth labels v;as obtained by analyst examination and 
interpretation of the ground-truth field overlay, aerial color infrared 
photographs, and the Landsat imagery. The analysts visually correlated field 
location and correct labeling for the 209 dots. The results are presented 
using both sets of ground truth. 

3.2.2 RESULTS AND DISCUSSION 

7(a) shows the average accuracy of machine classification for the 209 
-j , key partition, acquisition date, ancl APU. Low -(30.3 percent) 
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Group 


Sample 

size 


Crop reporting dist. 1 
Crop reporting dist. 3 
Crop reporting dist. 4 
Crop reporting dist. 5 
Crop reporting dist. 6 
Crop reporting dist. 7 
Crop reporting dist. 9 

Key partition 21 
Key partition 24 
Key partition 25 
Key partition 26 
Key partition 27 
Key partition 29 

Acguisiticn late® 140 
Acquisition date® 150 
Acquisition date® 170 
Acquisition date® 190 

Agrophysical unit 19 
Anrophysical unit 20 
Agrophysical unit 21 

Overa 1 1 


3 

4 
2 
2 
1 

3 

2 

1 

4 
3 
6 
1 
3 

1 

3 

8 


6 

4 

8 

18 
































and moderately high (87.9 percent) accuracies were observed for segments from 
CRD 5 and CRD 6, respectively. Variability was less in accuracies from the 
key partitions compared to the variability in accuracies from the CROs. Par- 
tition 29 had a relatively low (40.6 percent) accuracy, but small-grain dots 
from partition 21 classified 84.1 percent correctly. Machine classification 
accuracies improved with more acquisitions, and accuracies were better for 
segments classified using later dates. There was not much difference between 
accuracies among the APUs. The overall accuracy for the 18 segments averaged 
to 62.6 percent for small grains and 88.8 percent for nonsmall grains. Simi- 
lar trends were observed from results [table 7(b)] obtained with AA tape ground 
truth. 

In table 8(a), the accuracy of labeling spring wheat dots classified as small 
grains is presented along with the accuracies of labeling spring grain dots 
classified and ground truth identified as small grains. The labeling accu- 
racies for small grains were over 95 percent in most cases except for APU 19, 
which was rather low (22.8 percent). Higher accuracies indicate that the 
analysts were able to identify and label spring wheat dots more accurately 
if segments were grouped according to key partitions rather than by CRDs, by 
APU, or by acquisition dates. Because of confusion and difficulty in sepa- 
rating wheat, barley, and other small grains, the overall correct labeling 
percentage was very low (52.8 percent). Slightly better results were ob- 
tained from data using the analyst ground truth than the results obtained 
from data using the AA ground truth [table 8(b)]. 

"he accuracies for labeling spring wheat dots based on the analyst ground 
truth and the AA tape ground truth are presented on tables 9(a) and 9(b), 
respectively. The accuracies for correct labeling were 59.1 percent for 
spring wheat dots and 94.1 percent for nonsmall -grain dots. The probabili- 
ties for correct labeling of spring wheat dots given that they are small 
'.rains were less than 50 percent. 

’ ratios of spring wheat to small grains for dots classified as small grains 

• '"itins of spring wheat to small grains for dots cTtssified as 

original 

OF 


PAGE IS 
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TABLE 7.- Concluded. 


(b) Accuracy of machine classification obtained with 
AA tape ground truth. 


Group 

Sample 

P9 

(a) 

PIO 

(b) 

Pll 

(c) 

P12 

(d) 

Crop reporting dist. 1 

3 

0.516 

0.764 

0.721 

0.879 

Crop reporting dist. 3 

4 

.821 

.830 

.796 

.772 

Crop reporting dist. 4 

2 

.393 

.607 

.848 

.953 

Crop reporting dist. 5 

2 

.355 

.639 

.815 

.954 

Crop reporting dist. 6 

1 

.830 

.830 

.837 

.844 

Crop reporting dist. 7 

3 

.533 

.431 

.793 

.846 

Crop reporting dist. 9 

3 

.671 

.770 

.790 

.859 

Key partition 21 

1 

0.797 

0.859 

0.900 

0.903 

Key partition 24 

4 

.804 

.850 

.821 

.822 

Key partition 25 

3 

.659 

.845 

.765 

.844 

Key partition 26 

6 

.498 

.514 

.797 

.867 

Key partition 27 

1 

.600 

.682 

.756 

.843 

Key partition 29 

3 

.396 

.660 

.748 

.909 

Acquisition date® 140 

1 

0.429 

0.774 

0.627 

0.856 

Acquisition date® 150 

3 

.493 

.607 

.750 

.844 

Acquisition date® 170 

8 

.709 

.732 

.814 

.828 

Acquisition date® 190 

6 

.531 

.681 

.812 

.911 

Agrophysical unit 19 

6 

0.615 

0.736 

0.796 

0.865 

Agrophysical unit 20 

4 

.756 

.861 

.788 

.821 

Agrophysical unit 21 

8 

.507 

.Ci84 

.791 

.877 

Overal 1 

18 

0.598 

0.696 

0.792 

0.861 


®P 9 = pr(f< = SG/6T = SG) - Probability that the machine classified small grains given 
.that the ground truth is small grains. 

“PIO = Pr(GT = SG/M = SG) — Probability that the ground truth is small grains given 
that the machine classified small grains. 

^Pll = Pr(correct classification) - Probability of correct classification 
«P 12 s pr(M = N/GT = N) - Probability that the machine classified nonsmall grains 
given that the ground truth is nonsmall grains. 

^Acquisition dates are given in 10-day increments. 
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TABLE 8.- DIRECT WHEAT EVALUATION RESULTS OF LABELING SPRING 
WHEAT CLASSIFIED AS SMALL GRAINS 

(a) Results obtained with analyst ground truth. 




Group 

^^ample 

size 

P5 

P6 

P7 

P8 

(a) 

(h) 

(0 

(d) 

Crop reporting disx. 1 

3 

0.763 

0.957 

0.853 

0.578 

Crop reporting dist. 3 

4 

.652 

.972 

.886 

.558 

Crop reporting dist. 4 

2 

.687 

.976 

.847 

.482 

Crop reporting dist. 5 

2 

.789 

.898 

.810 

.608 

Crop reporting dist. 6 

1 

.845 

1.000 

.916 

.600 

Crop reporting dist. 7 

3 

.791 

.992 

.797 

.352 

Crop reporting dist. 9 

3 

.795 

.962 

.832 

.505 

Key partition 21 

1 

0.800 

0.983 

0.919 

0.516 

Key partition 24 

4 

.816 

.972 

.909 

.559 

Key partition 25 

3 

.825 

.950 

.883 

.578 

Key partition 26 

6 

.759 

.980 

.794 

.428 

Key partition 27 

1 

.930 

.964 

.828 

.606 

Key partition 29 

3 

.693 

.934 

.808 

.566 

Acquisition date® 140 

1 

0.674 

1.000 

0.803 

0.516 

Acquisition date® 150 

3 

.850 

.943 

.776 

.559 

Acquisition date® 170 

8 

.798 

.981 

.827 

.502 

Acquisition date® 190 

6 

.772 

.949 

.912 

.638 

Agrophysical unit 19 

6 

0.687 

0.228 

0.837 

0.554 

Agrophysical unit 20 

4 

.826 

.966 

.920 

.558 

Agrophysical unit 21 

8 

.775 

.967 

.815 

.560 

Overall 

18 

0.791 

0.965 

0.846 

0.528 


a 


b 


c 


d 

e 


P5 = Pr(AI * SW/GT = SW and M = SG) - Probability that the AI labeled spring wheat 
given that the ground truth is spring wheat and the machine classified small 
grains. 

P6 = Pr(AI = SG/GT = SG and M = SG) - Probability that the AI labeled small grains 
given that the ground truth is small grains and the machine classified small 
grains. 

P7 = Pr(GT = SG/AI = SG and M = SG) - Probability that the ground truth is small 
grains given that the AI labeled small grains and the machine classified small 
grains. 

P8 = Pr(correct labeling over all) - Probability of correct labeling over all. 



in iG-day increments. 
42 


k.' 
























TABLE 8.- Concluded. 

(b) Results obtained with AA tape ground truth. 


Group 

■m 

P5 

(a) 

— 

P7 

(c) 

P8 

(d) 

Crop reporting dist. 1 

3 

0.746 

0.944 


0.507 

Crop reporting dist. 3 

4 

.833 

.912 


.529 

Cron reporting dist. 4 

2 

.667 

.967 


.343 

Crop reporting dist. 5 

2 

.770 

.879 

.713 

.585 

Crop reporting dist. 6 

1 

.830 

1.000 

.874 

.540 

Cron reporting dist. 7 

3 

.693 

.988 

.476 

.335 

Crop reporting dist. 9 

3 

.813 

.966 

.799 

.500 

Key partition 21 

1 

0.848 

0.982 

0.871 

0.516 

Key partition 24 

4 

.811 

.922 

.881 

.525 

Key partition 25 

3 

.817 

.944 

.882 

.584 

Key partition 26 

6 

.702 

.974 

.545 

.362 

Key partition 27 

1 

.914 

.956 

.672 

.485 

Key partition 29 

3 

.708 

.912 

.702 

.503 

Acquisition date® 140 

1 

0.658 

1.000 

0.787 

0.484 

Acquisition date® 150 

3 

.825 

.927 

.666 

.502 

Acquisition date® 170 

8 

.762 

.953 

.754 

.448 

Acquisition date® 190 

6 

.761 

.938 

.712 

.494 

Agrophysical unit 19 

6 

0.773 

0.945 

0.773 

0.512 

Agrophysical unit 20 

4 

.822 

.916 

.886 

.527 

Aqrophysical unit 21 

8 

.738 

.967 

.613 

.420 

Overall 

18 

0.766 

0.946 

0.727 

0.474 


P5 * Pr(AI = SW/GT = SW and M = SG) — Probability that the AI labeled spring wheat 
.given that the ground truth is spring wheat and the machine classified small grains 
P6 = Pr(AI = SG/GT = SG and M = SG) — Probability that the AI labeled small grains 
given that the ground truth is small grains and the machine classified small grains 
'"P7 •= Pr(GT = SG/AI = SG and M = SG) — Probability that the ground truth is small 
grains given that the AI labeled small grains and the machine classified small 
.grains. 

°P8 = Pr(correct labeling over all) - Probability of correct labeling over all. 
^Acquisition dates are given in 10-day increments. 


43 

































TABLE 9.- DIRECT WHEAT EVALUATION RESULTS OF ANALYST LABELING 

SPRING WHEAT DOTS 

(a) Results obtained with analyst ground truth. 


r 

1 

i Group 

1 

HSi 

PI 

(a) 

P2 

(b) 

P3 

(c) 

P4 

(d) 

j Crop reporting dist. 1 

3 

0.561 

0.904 

0.657 

0.420 

Crop reporting dist. 3 

4 

.770 

.923 

.683 

.550 

Crop reporting dist. 4 

2 

.514 

.981 

.871 

.458 

Crop reporting dist. 5 

2 

.419 

.955 

.740 

.344 

Crop reporting dist. 6 

1 

.720 

.943 

.763 

.525 

Crop reporting dist. 7 


.450 

.932 

.778 

.368 

Crop reporting dist. 9 


.693 

.971 

.791 

.444 

Key partition 21 


0.706 

0.972 

0.828 

0.464 

Key partition 24 


.708 

.951 

.719 

.509 

Key partition 25 


.736 

.937 

.746 

.508 

Key partition 26 


.499 

.950 

.811 

.426 

Key partition 27 


.805 

.892 

.750 

.647 

Key partition 29 


.362 

.917 

.611 

.266 

Acquisition date® 140 

1 

0.478 

0.820 

0.553 

0.250 

Acquisition date® 150 

3 

.526 

.936 

.676 

.396 

Acquisition date® 170 

8 

.628 

.934 

.742 

.450 

Acquisition date® 190 

6 

.591 

.972 

.812 

.498 

Aqrophysical unit 19 

6 

0.555 

0.927 

0.696 

0.391 

Agrophysical unit 20 

4 

.718 

.949 

.684 

.495 

'grophysical unit 21 

8 

. 554 

.947 

.811 

.463 

C /era 11 

18 

0.591 

0.941 

0.741 

0.474 


'"Pl = Pr(AI = SW/GT = SW) - Probability that the AI labeled spring wheat given that the 
.ground truth is spring wheat. 

^P2 = Pr(AI = N/GT = N) - Probability that the AI labeled nonsmall grains given that 
the ground truth is nonsmall grains. 

Sp 3 = overall accuracy - overall accuracy of labeling. 

= Pr(correct label/GT = SG) — Probability of correct labeling given th«t the around 
truth is small grains. 

^^Acquisition dates are given in 10-day increments. 








TABLE 9.- Concluded. 

(b) Results obtained with AA tape ground truth. 


Group 


Crop reporting dist. 1 
Crop reporting dist. 3 
Crop reporting dist. 4 
Crop reporting dist. 5 
Crop reporting dist. 6 
Crop reporting dist, 7 
Crop reporting dist. 9 


Key partition 21 
Key partition 24 
Key partition 25 
Key partition 26 
Key partition 27 
Key partition 29 


Acquisition date® 140 


Acquisition date® 150 


Acquisition date 170 
Acquisition date® 190 


Aqrophysical unit 19 
Agrophysical unit 20 
Agrophysical unit 21 


Overal 1 







PI 

P2 

(a) 

(b) 

0.520 

0.844 

.696 

.859 

.425 

.956 

.477 

.934 

.621 

.940 

.351 

.870 

.634 

.943 

0.765 

0.944 

.638 

.901 

.742 

.924 

.407 

.901 

.692 

.725 

.348 

.891 

0.500 

0.852 

.483 

.878 

.589 

.898 

.511 

.910 

0.524 

0.908 

.667 

.887 

.489 

.891 

0.540 

0.896 



0.818 

.665 

.573 

.796 

.648 

.583 


0.606 

.658 

.661 

.750 


0.591 

.630 

.788 


0.687 


0.392 


®P1 = Pr(AI = SW/GT = SW) - Probability that the AI labeled spring v/heat given that the 
.ground truth is spring wheat. 

“P2 = Pr(AI = N/GT = N) - Probability that the AI labeled nonsmall grains given that the 


ground truth is nonsmall grains. 

£P3 = overall accuracy - overall accuracy of labeling. 

^P4 * Pr(correct label/GT = SG) - Probability of correct labeling given that the ground 
truth is small grains. 


'Acquisition dates are given in 10-day increments. 
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nonsmall c-'e'ns are shown in table 10(a) and table 10(b). The Student's 
t-test shs'^si that the ratios are equal (the difference between the ratios is 
not significantly different from zero at the 5-percent level). 

To test whether the accuracies obtained for discriminating small grains from 
nonsmall c'-ains were greater than those from random chance, the average perform- 
ance was ccrcjuted and the values were tabulated. Results [table 11(a)] 
showed that the accuracies from analyst labeling in discriminating small 
grains frc" nonsmall grains are 64.6 percent better (over all 18 segments) 
than randcr chance. Likewise, the data with AA tape ground truth from 
table 11(b) showed 54.4-percent improvement with analyst labeling over ran- 
dom chance in discriminating small grains from nonsmall grains. However, the 
accuracies [table 11(c) and table 11(d)] obtained for discriminating wheat 
■from nonwheat were 46.4 percent and 37.0 percent better than random chance 
for results with analyst ground truth as well as those with accuracy assess- 
ment tape ground truth, respectively. 

Table 12 presents the wheat and small grains proportion estimates along with 
the corresponding actual or ground-truth percentages. Average percentages of 
small grains were significantly underestimated for segments in key partition 29, 
with latest acquisition dates and over all 18 segments. Similarly, percent- 
age spring wheat estimates were significantly understated for segments in the 
last APU and those in the 190-acquisi'tion dates. 

3.2.3 Si;W^Y OF FINDINGS 

A large nur.ber of the barley and oat pixels was incorrectly labeled spring 
wheat, whereas only a small number of spring wheat pixels was incorrectly 
labeled other small grains. As a result, ratios of wheat to other small 
grains were biased high. 

The ratio of v/heat to small grains for those pixels classified as small grains 
*.is ret ficantly different from the same ratio for those pixels classi- 

fied as nor.s".dll grains. Analyst labeling accuracies were significantly 
■ ' ■''j'Miom chance. 
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TABLE 10.- DIRECT WHEAT EVALUATION RESULTS ASSUMING THE RATIO OF SW 
TO SG IS THE SAME FOR THOSE PIXELS CLASSIFIED SG AS IT IS 
FOR THOSE PIXELS CLASSIFIED AS NONSMALL GRAINS 

(a) Obtained with analyst ground truth. 


Group 


SW/SG 
given SG 
(a) 

■jQQIIIig 

Crop reporting dist. 1 

3 

0.848 

0.681 

Crop reporting dist. 3 

4 

.637 

. 606 

Crop reporting dist. 4 

2 

.821 

.682 

Crop reporting dist. 5 

2 

.781 

.824 

Crop reporting dist. 6 

1 

.667 

.583 

Crop reporting dist. 7 

3 

.8.38 

.834 

Crop reporting dist. 9 

3 

.690 

.795 

Key partition 21 

1 

0.603 

0.781 

Key partition 24 

4 

.646 

.668 

Key partition 25 

3 

.728 

.577 

Key partition 26 

6 

.822 

.787 

Key partition 27 

1 

.781 

.844 

Key partition 29 

3 

.820 

.722 

Acquisition date^ 140 

1 

0.878 

MM 

Acquisition date^ 150 

3 

.715 


Acquisition date^ 170 

0 

.670 

.703 

Acquisition date^ 190 

6 

.861 

.794 

Agrophysical unit 19 

6 

0.730 

0.705 

.'^grophysical unit 20 

4 

.647 

.617 

Agrophysical unit 21 

8 

.822 

.781 

Overall 

18 

.753 

.719 


®SW/SG given SG = actual ratio of spring wheat to small grains 
^(for dots classified as small grains). 

'SW/S6 given N = actual ratio of spring wheat to small grains 
(for dots classified as nonsmall grains). 

^Acquisition dates are given in 10-dny increments. 
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TABLE 10.- Concluded. 

(b) Obtained with AA tape ground truth. 


Group 


SW/SG 
given SG 
(a) 

B 

Crop reporting dist. 1 

3 

0.837 


Crop reporting dist. 3 

4 

.635 


Crop reporting dist. 4 

2 

.850 


Crop reporting dist. 5 

2 

.807 

.747 

Crop reporting dist. 6 

1 

.639 

.824 

Crop reporting dist. 7 

3 

.761 

.806 

Crop reporting dist. 9 

3 

.691 

.741 

Key partition 21 

1 

0.600 

0.643 

Key partition 24 

4 

.631 

.698 

Key partition 25 

3 

.746 

.592 

Key partition 26 

6 

.795 

.779 

Key partition 27 

1 

.778 

.900 

Key partition 29 

3 

.816 

.670 

Acquisition date^ 140 

1 

0.854 

0.375 

Acquisition date‘s 150 

3 

.721 

.702 

Acquisition date^ 170 

8 

.671 

.726 

Acquisition date^ 190 

6 

.829 

.750 

Agrophysical unit 19 

6 

0.727 

0.695 

Agrophysical unit 20 

4 

.636 

.594 

Agrophysical unit 21 

8 

.806 

.781 

Overall 

18 

0.742 

0.711 

a 

SW/SG given SG = actual ratio of spring wheat to small grains 
u(for dots classified as small grains). 

°SW/SG given N= actual ratio of spring wheat to small grains 
(for dots classified as nonsmall grains), 

^Acquisition dates are given in 10-day increments. 
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TABLr 11.- niRrCT WlirAT {valuation rcsults of a tfst to dftfrmine 

WfICTIIfR ACCURACIFS FOR DISCRIMINATINO SMALL GRAINS FROM 
nonsmall GRAINS ARL GRLATFR THAN THAT FOR RANDOM CHANCC 

(a) Accuracies obtained with analyst ground truth. 


Group 

Sample 
si 70 

Average 

performance 

(a) 

Standard 

deviation 

Crop report inq cHst. 1 

3 

*'0.47il 

0.248 

Crop reporting dist, 3 

4 

‘‘n. ’55 

0.211 

Crop reporting dist, 4 

> 

^O.P.M 

0.183 

Crop reporting dist. 5 

« 

'*0.4P(- 

0.333 

Crop reporting dist. 6 

1 

0.H23 


Crop reporting dist, 7 

3 

*^0.570 

0.189 

Crop reporting dist, o 

3 

^0.8111 

0.078 

Key partition 21 

1 

0.847 


Key partition 24 

4 

*^0.857 

0.030 

Key partition 25 

3 

*^0.666 

0.210 

Key partition ^6 

6 

*^0.614 

0.148 

Key partition 27 

1 

0.702 

- 

Key partition 24 

3 

^0.321 

0.173 

Acquisition date*'' 140 

1 

0.212 

- 

Acquisition date^ 150 

3 

^’n.487 

0.251 

Acquisition date^ 170 

11 

*^0.750 

0.197 

Acquisition date*^ 190 

6 

*^0.818 

0.202 

Agrophysical unit la 

{' 

*^0.581 

0. lOo 

Agrophysical unit 20 

4 

‘•'0.7hl 

0.214 

Agrophysical unit 21 

11 

^0.8.18 

0.131 

Overai 1 

111 

*'0.848 

0.218 


“Avoraae Forfon»,,no.- • ' "''“J ■ N)] - K 

1 " K 

where K • Pr(Sn^,^ )Pr(sr,^j ) f Fr(N^^^ )Pr (N^j ) 

^The averaqe nmoiTunce was siani t icantl v di iTorent frori ramiom olianc.' at 
^the &-per(.enf levi'l. 

The average I'erformanoe was siiini t u antly different fiH'ni t'andem ehanee at 
^^the 1 -percent level. 

'The aveea.,e .'I'rt.'! ■ ,eu e w.e. net Mentiuantlv ditfi'eent freni randein chance 
^,at the h-percent level. 

M ,i'i , ti, ! ' ,>i. t'u en' . 
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TABLE n Continued. 

(b) Accuracies obtained with AA tape ground truth 


Group 

Sample 

size 

Average 

performance 

(a) 

Standard 

deviation 

Crop reporting dist. 1 

3 

■■Bim 


Crop reporting dist. 3 

4 



Crop reporting dist. 4 

2 


HiS 

Crop reporting dist. 5 

2 

®0.453 


Crop reporting dist. 6 

1 

0.760 

- 

Crop reporting dist. 7 

3 

n 

o 

0.051 

Crop reporting dist. 9 

3 

®0.716 

0.130 

Key partition 21 

1 

0.773 

— 

Key partition 24 

4 

®0.727 

0.084 

Key partition 25 

3 

*’0.662 

0.213 

Key partition 26 

6 

®0.465 

0.125 

Key partition 27 

1 

0.452 

- 

Key partition 29 

3 

*’0.292 

0.171 

Acquisition date® 140 

1 


— 

Acquisition date® 150 

3 

®0.364 

0.233 

Acquisition date® 170 

8 

®0.642 

0.195 

Acquisition date® 190 

6 

®0.518 

0.174 

Agrophysical unit 19 

\ 

6 

®0.530 

0.283 

Aqrophysical unit 20 

4 

®0.641 

0.171 

Aqrophysical unit 21 

8 

'’0.505 

0.158 

Overal 1 

18 

'’0.544 

0.205 


Verage performance = N/GT = N)] - K 

where K = Pr(Wgj)Pr(W^j ) Pr(N(,^)Pr(N^j ) 

^The average performance is significantly different from random chance at 
the 5-percent level. 

'"The average performance is significantly different from random chance at 
jthe 1 -percent level. 

The average performance was not significantly different *rom random dance 
at the 5-percent level. 

^Acquisition dates are given in 10-day increments. 
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TABLE 11.- Continued. 


(c) Accuracies obtained in discriminating wheat from 
nonwheat using analyst ground truth. 


Group 

Sample 

size 

Average 

performance 

(a) 

Standard 

deviation 

Crop reporting dist. 1 

3 

®0.412 

0.137 

Crop reporting dist. 3 

4 

®0.481 

0.165 

Crop reporting dist. 4 

2 

‘^0.552 

0.316 

Crop reporting dist. 5 

2 

‘^0.366 

0.361 

Crop reporting dist. 6 

1 

0.512 

— 

Crop reporting dist. 7 

3 

^0.433 

0.167 

Crop reporting dist. 9 

3 

®0.516 

0.102 

Key partition 21 

1 

0.593 

- 

Key partition 24 

4 

®0.440 

0.151 

Key p.artition 25 

3 

®0.566 

0.079 

Key partition 26 

6 

®0.493 

0.188 

Key partition 27 

1 

0.568 

— 

Key partition 29 

3 

*^0.260 

0.131 

Acquisition date® 140 

1 

0.309 

— 

Acquisition date® 150 

3 

‘^0.422 

0.271 

Acquisition date® 170 

8 

®0.425 

0.142 

Acquisition date® 190 

6 

®0.563 

0.137 

Agrophysical unit 19 

6 

®0.393 

0.172 

Agrophysical unit 20 

4 

®0.462 

0.170 

Aqrophysical unit 21 

8 

®0.518 

0.167 

Overall 

18 

®0.464 

0.169 


“Average performance = m ... l ^) 3 , - K 

where K » Pr(Wg^)Pr(W^j ) + ) 

^The average performance is significantly different from random chance at 
the 5-percent level. 

^The average performance is significantly different from random chance at 
.the 1 -percent level. 

°The average performance was not significantly different from random chance 
at the 5-percent level. 

^Acquisition dates are given in 10-day increments. 
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TABLE 11.- Concluded. 


(d) Accuracies obtained in discriminating wheat from 
nonwheat using AA tape ground truth. 


Group 

Sample 

size 

Average 

performance 

(a) 

Standard 

deviation 

Crop reporting dist. 1 

3 


0.025 

Crop reporting dist. 3 

4 


0.128 

Crop reporting dist. 4 

2 


0.255 

Crop reporting dist. 5 

2 

°0.425 

0.539 

Crop reporting dist. 6 

1 

0.429 

- 

Crop reporting dist. 7 

3 

®0.184 

o.no 

Crop reporting dist. 9 

3 

®0.505 

0.135 

Key partition 21 

1 


— 

Key partition 24 

4 


0.107 

Key partition 25 

3 



Key partition 26 

6 

®0.301 

0.185 

Key partition 27 

1 

0.341 

— 

Key partition 29 

3 

®0.221 

0.155 

Acquisition date® 140 

1 


— 

Acquisition date® 150 

3 


0.250 

Acquisition date® 170 

8 

^^0.367 

0.161 

Acquisition date® 190 

6 

®0.402 

0.255 

Agrophysi''al umt 19 

6 

■H 

0.202 

Agrophysical unit 20 

4 


0.128 

Agrophysical unit 21 

8 

*^0.369 

0.236 

Overall 

18 

‘^0.370 

0.195 


=Aver.9s performance = [ Pe(Al - H/GLj . iO . f . Pr . tAl . N/GT ■ N) ] ■ K 

where K = Pr(Wg^)Pr(W^j ) + Pr(NQ-j-)Pr(N^j) 

^The average performance is significantly idfferent from random 
chance at the 5-percent level. 

^The average performance is significantly different from random 
j^chance at the 1 -percent level. 

Tr.e average performance was not significantly different from ran- 
'■►'ance at the 5-percent level. 

’ si tion dates are given in IC-uay increments. 
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TABLE 12 - DIRECT WHEAT EVALUATION RESULTS OF WHEAT AND SMALL 
GRAINS' PROPORTION ESTIMATES 


[ 


Group 

Sample 

size 

S SW 

(a) 

~ SW 
(b) 

(c) 

% SGpT 

(d)"' 

Crop reporting dist. 1 

3 

22.03 

■ 26.67 

30.17 

49.13 

Crop reporting dist. 3 

4 

44.10 

52.88 

34.64 

56.25 

^ Crop reporting dist. 4 

2 

12.75 

17.10 

17.53 

22.94 

Crop reporting dist. 5 

2 

16.35 

19.40 

19.81 

24.99 

Crop reporting dist. 6 

1 

40.20 

52.20 

31.70 

48.62 

Crop reporting dist. 7 

3 

18.43 

25.93 

31.13 

37.08 

Crop reporting dist. 9 

3 

26.67 

33.57 

24.75 

37.04 

Key partition 21 

1 

20.80 


16.63 

29.59 

Key partition 24 

4 

39.22 

49.15 

33.34 

52.44 

Key partition 25 

3 

38.63 

45.10 

31.86 

49.47 

Key partition 26 

6 

18.18 

24.17 

25.67 

31.45 

Key partition 27 

1 

23.90 

26.00 

37.70 

65.99 

Key partition 29 

3 

16.53 

^20.67 

21.93 

32.32 

Acquisition date® 140 

1 

28.60 

35.00 

28.37 

50.28 

Acquisition date® 150 

3 

27.93 

31.87 

25.33 

37.64 

Acquisition date® 170 

8 

31.98 • 

'11.45 

28.16 

43.25 

Acquisition date® 190 

6 

^17.98 

^22.17 

28.91 

38.38 

Aqrophysical unit 19 

6 

25.52 

32.40 

24.27 

37.26 

Agrophysical unit 20 

4 

41.20 

49.75 

34.78 

56.68 

Agrophysical unit 21 

8 

^19.79 

25.22 

27.30 

36.14 

Overall 

18 

^24. 46 

^33.07 

27.95 

41.08 


?XSW = spring wheat proportion estimate. 

= small -grains' proportion estimate. 

= spring wheat tape ground-truth proportion. 

‘^JSGgj = small grains' tape ground-truth proportion. 

^Acquisition dates are given in 10-day increments. 

^The wheat proportion estimate is significantly different from ground truth at the 
5-percent level. 

^The wheat proportion estimate is not significantly different from ground truth at the 
5-percent level. 

^The wheat proportion estimate is significantly different from ground truth at the 
1 -percent level. 
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The analyst labeling (spring wheat, barley, oats) of machine-classified pixels 
resulted in an 8-percent understatement of the small grains proportion. The 
LACIE PHASE III CAMS spring wheat proportions did not vary significantly from 
the spring wheat ground-truth proportions. The spring wheat estimate was 
calculated as 

/\ A 

^SW ^ ''SW/SG * ^S6 

where 

A 

P-y - spring wheat estimate 

A 

'^SW/SG " estimate of the ratio of spring wheat to total small grains 

A 

PgQ = BCE for small grains 

A A 

The evaluation results show that was overstated, P^g was understated, 

and Pg^^ was nearly correct. 

The statistical analysis illustrated that additional research was needed to 
improve correct labeling of individual spring wheat pixels, even though the 
overall spring wheat estimate did not vary significantly from the ground- 
truth proportions. A study incorporating gro!;nd-truth information and Landsat 
data was outlined to refine the LACIE Phase III direct wheat procedure. 


4. LANDSAT IMAGERY AND SPECTRAL DATA USING GROUND-TRUTH LABELS 


The following is a description of the Landsat imagery and the spectral data 
studied and how these data were evaluated. Tables 13 and 14 list blind 
site segments in the study and the results of each evaluation. 

4.1 VISUAL STUDY OF THE LANDSAT IMAGERY 

LACIE Product 1 is a film product created by the production film converter 
(PFC) from Landsat digital values in channels 1, 2, and 4 of the multi- 
spectral scanner. Channel color assignments are blue, green, and red, 
respectively. This product provided the image analyst with the maximum field 
contrast possible in the scene. Unfortunately, contrast is sometimes achieved 
at the expense of consistent color depiction of spectral values (ref. 11). 

Product 1 was studied to determine whether or not small grains were visually 
separable and, if visually separable, to determine how consistently. Barley 
was visually separable from wheat and oats on 6 out of 18 segments, but the 
crop signatures were not always consistent within the segment. Refer to 
appendix C for field signatures on specific acquisitions. 

LACIE Product 3, a film product using channels 1, 2, and 4, was designed to 
preserve interchannel relationships and to provide a more consistent display 
of spectral signatures. In contrast to Product 1, Product 3 did not 
necessarily use the entire range of color for each channel (ref. 11). 

This product was studied to discern separation of small grains that was not 
apparent on Product 1. Two out of five segments with adequate Product 3 
acquisition histories showed wheat and barley to be visually separable. One 
segment (1640) on Julian date 7193 appeared to show more separation than 
Product 1 for that acquisition date. 


TABLE 13.- SUMf-lARY OF NORTH DAKOTA BLIND SITE STUDY ON THE SEPARATION OF WHEAT FROM SHALL GRAINS 
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TABLE 13.- Continued. 
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insufficient data because of Product 3's poor acquisition history. 
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TABLE 13.— Concluded 
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TABLE 14.— Concluded. 
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4.2 EVALUATION OK THE SPECTRAL DATA 


Various graphic representations of the Landsat spectral data and ground-truth 
information were analyzed to determine numeric parameters for the separation 
of small grains and optimal crop calendar development stage. The Wehmanen 
implementation of the Kauth data transformations (ref. 12) was the basis for 
most of the graphs generated. Time variables and raw channel data values 
were also evaluated. The Kauth data transformations are expressed as green 
number and brightness values. 

4.2.1 SCATTER PLOTS (GREEN NUMBER VERSUS BRIGHTNESS) 

The scatter plot was generated to observe possible differences between the 
small grains in Kauth space. Separation of barley and other small grains 
was apparent at the wheat soft dough stage for 4 of the 18 segments (seg- 
ments 1640, 1663, 1899, and 1927). Refer to figures 10 to 13 for examples. 

4.2.2 GREEN NUMBER AND BRIGHTNESS VERSUS TIME 

These two plots were evaluated to determine in which Kauth space and on what 
date separation might be apparent. No significant inputs toward separation 
were ascertained, but the plots clearly illustrated late emerging fields. 

Refer to figure 14. 

4.2.3 RAW CHANNEL DATA PLOTS 

These plots were studied to explore the probability that the separation of 
small grains is possible without data transformation. Four of 18 segments 
indicated separations in the channel 2 versus 3 and 2 versus 4 plots. These 
separations did not seem to be as well defined as the separations shown on 
the green number versus brightness plots. Refer to figure 15. 

4.2.4 CROP CALENDAR PLOTS 

Eight crop calendar plots were analyzed to determine crop calendar differences 
based on Kauth vectors. No additional separation information was obtained 
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(b) Acquisition date, 77211. 
Figure 10. Concluded. 
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Figure 11 .■ Concluded. 


67 





RPFCTKAL FU1--S 

■C'L'iT }(■«« 7719R 












•i: * 

♦ 

4 

.... ^ ^ 

♦ * . 
. 1 

*. 

4' ' 

♦ 


4 

4 

t * 

* 

*n • * • 

4 

♦ 

* 





B 




*: • 

4 

4 

* * S 

B S ♦ ♦ 

4 

♦ 

♦ 




ti 

. . 








1 








B . S 







SfcAS 

. '. B 




35 ♦ 

4 

4 

. ss s 

* * 

4 

♦ 

• 




s 

• H . 







S S5 

B B H B 6 







SS" ■ “ 

s fl SE 





3: • 

4 

4 

♦ s s s * , 

* B • 

4 

• 

• 




S?S5S 

H B 







S S 1 iS 

B . B 







■= ss |S 

8 n 




' * 

“ 


ss S s 

■ b 

- 




♦ 

4 

♦ S S B, 

3 ♦ D li ♦ 

4 

• 

♦ 




s a s 

* 








B 3 an 







s ss • . a 








. '■ 

3 n B 




?: * - - - 

♦ "**■*' 


* s ■ ■ * ■ ^ 

■ “ ■ n ■ ■ ♦ • ■ 


...... - ^ _ 





s ,U 

8S B 







• 1 S 1 

0 







s 3 a 

S 3 







. e 

B a 




15 • 

4 

* 

• 3 • El f* • ^ 

B_ • _ _♦ 

* 

♦ 

• 




S *. *. 








........ . . 

- 0 








BB 

' 



n • 

4 

4 

*.♦ * 

* • 

* 

^4 

• 




• » I 1 





5 ♦ 

4 

4 

• 

. ♦ ♦ 

* * 

• 

4 

• 


• 


• % 

• 



V 

0 » 

• ♦ 1 

1 ♦ 



4 

4 

4 



• 

1 

• 




•5 • 

« 

• 

• • 

* * 

4 

4 

4 


yo 

40 

SC 6C 

7G BO 

90 

ICQ 

ilO 12 


l>WIG‘^TvESS 

r.).’: '.D TOoT„ liZ'-'CEK BIXPl.'? 

•'(WHlATB. ?*TS»A SARl.SVs'^ RYE»R FlAH'T S.'^hRATiS 


Figure 12.- 


Scatter plot 
green 


for segment 1899 (acquisition date, 77193) - 
number versus brightness. 
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Figure 13.- Scatter plot for segment 1927 (acquisition date, 77193) 

green number versus brightness. 
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Green number : Each space on the vertical axis represents a green number. 


T i me ; Time is expressed on the horizontal axis. 

Columns ; There are six columns per increment in the following order (left 
to right): spring v/heat (S), barley (B), oats (A), flax (F), winter wheat (W), 

and rye (R). 

D ata representation : The data points are represented with digitsjreflecting 

the number of hits for that point. An asterisk (*) is used for all digits 
over 9. 

(a) Green number versus tine. 

Figure 14.— Scatter plot of ground-truth data for spring 
wheat, barlev, oats, flax, winter wheat, and rve. 


■yj. 


l J 



Brinhtness : Each space on the vertical axis represents a brightness value. 
Time : Time is expressed on the horizontal axis. 

Data representation : The data points are represented with digits reflecting 
the number of hits for that point. An asterisk (*) is used for all digits 
over 9. 

(b) Brightness vet sus time. 

Figure 14.— Concluded. 
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Note: This scatter plot is provided for each acquisition. Six different 

graphs can be plotted: Channels 1 vs. 2, 1 vs. 3, 1 vs. 4, 2 vs. 3, 

2 vs. 4, and 3 vs. 4. Channels 1, 2, and 3 have a scale of 3 to 128; one 
space represents two radiance values. Channel 4 has a scale of 0 to 64; one 
space represents one radiance value. 

Data' representation : Data points are represented by the letter of the last hit. 

Listing: A listing of multiple hits was provided for these plots. 

(a) Segment 1663, channel 2 versus 3. 

Figure 15.- Radiance values for ground-truth labels. 
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(b) Segment 1663, channel 2 versus 4. 
Figure 15.- Continued. 
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(d) Segment 1899, channel 2 versus 4. 
Figure 15.— Concluded. 
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(d) Segment 1899, channel 2 versus 4. 
Figure 15.— Concluded. 
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from these graphic representations. Wheat development was assessed to be 
ahead of the nominal crop calendar and appeared to be consistent with the 
Robertson scale adjustment. Refer to figures 16 to 18. 

4.2.4 MEAN AND STANDARD DEVIATION LISTINGS 

Mean and standard deviation listings (see table 15) were used to derive 
figures 19 and 20 and to compute the 95-percent confidence limit discussed 
in section 5. 

Study of figures 19 and 20 resulted in the basic sunniations stated in table 14. 
Generally, barley was shown to have a larger green number than wheat on four 
segments and a larger brightness value than wheat on five segments. 
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Note: Separate graphs are plotted for spring wheat, barley, oats, and flax 

ground-truth data. 

Green nu mber: Each space on the vertical axis represents one green number. 

Robertson scale: Each space on the horizontal axis represents one-tenth. 

Data re presentation : Data points are represented with digits reflecting the 

number of hits at "that point. An asterisk (*) is used for all digits over 9 


Figure 16.* Green number versus adjusted Robertson scale. 
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Note : Separate graphs are plotted for spring wheat, barley, oats, and flax 

ground-truth data. 

Brightness : Each space on the vertical axis represents one brightness value. 

Robertson scale : Each space on the horizontal axis represents one-tenth. 

Data representation : Data points are represented with digits reflecting the 

number of hits at that point. An asterisk (*) is used for all digits over 9. 


Figure 17.- Brightness versus adjusted Robertson scale. 
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(a) Green number versus nominal Robertson scale - crop plot for spring wheat. 

Figure 18.--- Nominal crop calendar plots. 
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(b) Brightness versus nominal Robertson scale - crop plot 

for spring wheat. 


Figure 18.- Continued 
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(c) Green number versus nominal Robertson scale - crop plot for barley. 

Figure IS.- Continued. 


81 






SEG. 

NO. ACQUISITION DATES 


mttOMT».iSs 

CM* *L*T 


*S»fl*TS*N 

7^197 7U’» 771fJ 9 | 

S 0 Q 0 JO . Q 

fi fl . 0 . 

•» • • 

3 

1 

• • 

t 

• • • 

• 



- — - 


• 0 

• 

* 

3 

1 

1 

• 1 

1 

1. 

: 

• 

• 

• 

• 

• 




- 

— 






t 

1 




• 











1 

.1 

3 











M 

• 

• 

1 

• 2 

2« 

* 

* 

4 











I 

a 

t 



• 











3 

3 

4 



4 











3 

3 

1 



4 








>0 

• 

« 

9 

4 

0 

• 9 

2* 

• 

• 

4 

4 











4 

1 

3 



4 











I 

a 

9 



4 











I 

9 

S 



4 











4 

0 

4 



4 









• 

• 

2 

• 1 

1* 

• 

* 

4 











4 

0 




4 











t 

2 

a 



4 












9 

1 



4 











3 

1 

s 



4 









• 

• 


• t 

4* 

• 


4 










t 


_ y_. 

3 — - - 



4 

4 








1 



1 

2 

0 



4 








s« 

• 

« 

1 

*1 

i* 

• 

* 

4 










t 



3 



4 








1 


t 

\ 



9 

9 



4 

4 










X 

t 

a 




4 








II 

} 

1 


9 * 

9 

9 



# 

• 

♦ 

4 

4 

4 








1 

1 

41 

1 

1 

3 

• 

t 

9 

f * 

0 

9 

4 


• 


• 

• 

4 

4 

4 

4 

4 






- 

- 

9 

40 X 
i 
7 

• 

9 

• 

0 

f • 

9 

9 

• 

4 


* 

• 

• 

• 

• 

4 

4 

4 

4 

4 




- 



— 


H 1 

• 

7 • 


* 

TT 

* 

« 

4 








• 

S 

1 

1 


1 

1 






4 

4 

4 

4 







* * 

1 IS 

If 

1" H 

SI! 

- ir ‘ 

n ■ 41 IB 

II fS 

ii 

-TB 



— 






M4E<TS4» ICtLE 














(d) Brightness versus nominal Robertson scale 


crop plot for barley. 


Figure 18. ■ Continued. 
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Figure 18.- Continued. 
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Figure 18.- Concluded. 
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Figure 19.— Mean green number versus time (segment 1640). 





TABLE 15.- MEAN AND STANDARD DEVIATION LISTINGS 
























5. EVIHENCE SUPPORTING SMALL-GRAIN SEPARATION 


An evaluation of the 95-percent confidence limits of the true mean of wheat, 
barley, and oats for green number and brightness tends to support the fact 
that the various small grains can be separated depending on Landsat acquisi- 
tion date (tables 16 and 17). It can be assumed that if the 95-percent 
confidence limits do not overlap or if the overlap is insignificant, it msy 
be possible to separate the different crops. If the confidence limits are the 
same, separation probably would not be possible. In table 16, the green 
number shows only 2 of 9 possibilites at jointing and 1 of 12 at heading for 
possible separation. The brightness (table 17) shows wheat/barley separation 
on 3 of 9 at jointing, 1 of 12 at heading, 5 of 8 at soft dough, 1 of 3 at 
ripe, and 2 of 9 at harvest. It appears that the brightness vector contains 
more information for separation of the small grains than the green number 
vector. Acquisitions during wheat jointing and soft dough growth stages appear 
to provide the best opportunity for separation. Table 18 summarizes the data 
supporting the separation guidelines as presented in the LACIE Phase III 
direct wheat procedure. 




TA3LE 16.- 95-PERCENT CONFIDENCE UNITS OF TRUE MEANS OF WHEAT, BARLEY, AND OATS FOR GREEN NUMBER 

[Outlined boxes indicate separation possibilities.] 
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95-PERCENT CONFIDENCE LIMITS OF TRUE MEANS OF WHEAT. BARLEY, AND OATS FOR BRIGHTNESS 
[Outlined boxes indicate separation possibilities.] 
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TABLE 18.- SUMMARY OF DATA SUPPORTING WHEAT-BARLEY SEPARATION 


Data source 

LACIE Phase III direct wheat 
procedure separation guideline 

(a) 

(b) 

(c) 

(d) 

(e) 

(f) 

LACIE Phase III North 
Dakota blind site 
study 


X 

X 

X 



Earlier separa- 
tion studies 
(ref. 13) 



X 

X 



ERIM (ref. 5) 


X 

X 

mm 



LACIE field 
measurement 
data (ref. 14) 


X 


X 



North Dakota 
crop and live- 
stock statistics 
(refs. 6, 8, and 
15 to 18) 

X 


X 



X 


^Barley is generally planted after wheat. 

^Barley tends to green up sooner than spring wheat and to obtain higher levels. 
’'Barley turns and matures earlier than wheat. 

*^Barley tends to be brighter than wheat after heading. 

®Rye is greener than wheat. (Rye, a winter grain, was not considered in the 
spring wheat study. ) 

^Oats are not as green as wheat and may mature earlier than wheat. (Data on 
oats were limited.) 
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6. DIRECT WHEAT PROCEDURE 


6.1 INTRODUCTION 

The procedure recommendations and comments stated herein for a direct wheat 

procedure do not represent the final solution to the wheat estimation problem. 

They are representative of the data available to the analyst and are compatible 

with the current segment rli^sification procedure (Procedure 1). 

The procedure recommendations result from detailed analyses of the following: 

1. Small-grain signatures on PFC Product 1 

2. Small-grain signatures on PFC Product 3 

3. Scatter plots (green number versus brightness) 

4. Time plots (green number and brightness) 

5. Crop calendar plots (green number and brightness versus Robertson scale 
adjustable and nominal crop calendars) 

6. Means and standard deviation for small-grain dots 

7. Channel plots (radiance values) 

6.2 RECOMMENDED DIRECT WHEAT PROCEDURE 

The steps in the direct barley procedure are as follows: 

1. Classify by machine and obtain a BCE of small grains using Procedure 1. 

If possible, select a mid-heading to mid-ripe acquisition as the base 
acquisition. 

2. If there are not any acquisitions covering the mid-heading to mid-ripe 
development stages, pass a total small -grain estimate. If the necessary 
acquisitions are available, proceed to step 3. 
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3. Consult the historical statistics in conjunction with full-frame coverage. 
Decide the importan e of the various small grains in the county and relate 
that information to the segment. 

4. Check the crop calendar data, separation guidelines, green number growth 
patterns, and brightness patterns for the CRD in which the segment is 
located. 

5. Study the scatter plots for the mid-heading to mid-ripe acquisitions. 
Choose the acquisition that seems to show the most separability. Draw 
a decision line (as shown in fig. 21) separating wheat and oats from 
barley. 

6. Locate on the scatter plot each pixel classified S. Beside each S- 
classified pixel on a listing of dot classification ordered by dot number 
(table 4), place a B (barley) or OSG (other small grains) label. 

7. Omit those S pixels that are determined to be nonsmall grains. 

8. Tally the number of S pixels in the two grain classes (B and OSG). 

9. Determine the proportion of pixels given separation labels for the 
barley class. 

Number of B pixels 

Total number of pixels labeled B or OSG 

10. Determine the percentage of barley for the segment. 

Pg = Proportion of barley 

SGgc£ = BCE for small grains 

11. Subtract the percentage of barley from the BCE to obtain the percentage 
of other small grains in the segment. 

It would be necessary for CAS to ratio the oats from the OSG estimate. 


w, wheat*. 
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Figure 


21.- Scatter plot for segment 1899 (acquisition date, 77193) - 
green number versus brightness illustrating decision line 

for direct barley. 





6.3 PROCEDURAL PROBLEMS 


Six problems are inherent with the direct barley procedure. 

• Separation of small grains appears to be possible only during the mid- 
heading to mid-ripe stages. If acquisitions covering these development 
stages are missing, separation is not probable. 

• Oats are not separable from wheat in the available data set, thus indi- 
cating a continuing requirement for ratioing. 

• Wheat/barley separation is not always immediately obvious. 

• Low-density segments present a separability problem because of the low 
population of small -grain dots. 

• Border and edge pixels of small-grain fields do not represent "true" 
grain signatures. These are shaky pixels upon which to base separation 
decisions. 

• Specific parameters of green numbers and brightness values were not 
established because of segment-to-segment variability as well as crop 
development variability within the segment. 

6.4 RECOMMENDATIONS TO IMPROVE SEPARATION TECHNIQUES 

The following recommendations to improve separation techniques are offered: 

1. During the jointing, heading, soft dough, and ripe stages, 9-day coverage 
would be desirable for obtaining the best possible separation date. The 
scatter plots for segment 1663 illustrate the need for 9-day coverage. 

The acquisition dates 7174-7175 are too early for good separation of bar- 
ley from other spring small grains, and the acquisition date 7193 seems to 
be a little late. It is probable that coverage for 7183-7184 would have 
shown the best separability. 

2. Omitting border and edge pixels from the separation may improve the 
probability of obtaining estimates of barley and other small grains. This 
approach should be examined more closely. 
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3. Green number growth patterns and brightness plots by CRD for small grains 
would Illustrate the in-state variability. These should be adjustable 
according to planting and emergence dates, 

4. The adjustable crop calendar for barley (still in the development stage) 
would assist the analyst in choosing a separation date. One could compare 
the barley calendar to the adjustable spring wheat crop calendar and 
"know" when barley development moves ahecJ of spring wheat development. 

5. Historical acreage statistics for small grains and other major crops are 
necessary ancillary data for the analyst (as discussed in section 3.1,5). 

These statistics should be used with the full-frame data in ascertaining the 
importance of specific crops in the segment as related to the county as a 
unit. 
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7. SUMMARY 


The green number and brightness scatter plots, channel plots of radiance 
values, and visual study of the imagery indicate separability between barley 
and spring wheat/oats during the wheat mid-heading to mid-ripe stages. In 
the LACIE Phase III North Dakota data set, the separation time is more speci- 
fically the wheat soft dough stage. At this time, the barley is ripening - 
and therefore is less green and brighter than the wheat. Only 4 of the 18 
segments studied indicate separation of barley/other soring small grain, even 
though 11 of the segments have acquisitions covering the wheat soft dough 
stage. The remaining seven segments had less than 5 percent barley based 
on ground-truth data. 

Listed below are areas which require more investigation. 

1. Segments with a low density of small grains and a low percentage of bar- 
ley present a separation problem. 

2. The border/edge pixel problem in re'lation to separation should be 
studied. 

3. The channel plots of radiance values warrant further study. Segment 1899, 
acquisition 7193, indicates separation. Perhaps some type of data rota- 
tion or transformation could enhance this separation. 
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APPENDIX A 

JULIAN DATE CALENDAR 

The Julian date calendar (perpetual and for leap years only) is presented on 
the following pages. 
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329 

359 

24 

25 

025 

056 

085 

116 

146 

177 

207 

238 

269 

299 

330 

360 

25 

26 

026 

057 

086 

117 

147 

178 

208 

239 

270 

300 

331 

361 

26 

27 

0?7 

058 

087 

118 

148 

179 

209 

240 

271 

301 

332 

362 

27 

28 

028 

059 

088 

119 

149 

180 

210 

241 

272 

302 

333 

363 

28 

29 

029 

060 

089 

120 

150 

181 

211 

242 

273 

303 

334 

364 

29 

30 

030 


090 

121 

151 

182 

212 

243 

274 

304 

335 

365 

30 

31 

031 

,11 1 


091 


152 


213 

244 


305 


366 

•31 


(USE IN 1964, 1968, 1972, etc.) 


(b) For leap years only. 
Figure A-1 Concluded. 
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APPENDIX B 

ERROR CHARACTERIZATION FOR PHASE III NORTH DAKOTA BLIND SITES 

By J. M. Clinton 


A", 


APPENDIX B 


ERROR CHARACTERIZATION FOR PHASE III NORTH DAKOTA BLIND SITES 

By J. M. Clinton 


The type of errors that characterized the 18 blind sites in North Dakota 
during Phase III are presented in tables A-1 to A-5. 


The confusion matrices for these errors are as follows. 


jr% correctly labeled 

I total correctly 

I labeled small grain 

I total small grain labeled 


total nonsmall grain error 
total nonsmall grain labeled 

commission error 


% omission error 

tota l small grain error 
total small grain labeled 

total correctly labeled 

nonsmall grain 

total nonsmall grain labeled 

% correctly labeled 


Performance Analysis* Ground Truth 
Type 2 Type 1 


'341 
455 " 

0.750 

114 _ 
455 " 

0.250 

231 

310 = 0.745 

79 

310 " 

0.255 

30 

L563 ■ 

0.053 

533 
563 “ 

0.947 

3^= 0.059 

353 
375 ~ 

0.941 


*’'Performance Analysis" refers to the title of an administration section of 
personnel. 
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i>AGE BLANK NOT FILMED 


AA Tape Ground Truth 


Type 2 Type 1 



455 = 

= 0 323 
455 


= 0 645 
310 

0.355 


[5i^ “-'OS 

m - “-s®! 


[375 = 

0.912 

Total 

small grains 

labeled: 455, 

type 2; 310, type 1 



Total nonsmall grains labeled: 563, type 2; 375, type 1 
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CAUSES FOR OMISSION AND COMMISSION ERRORS IN LABELING 













TABLE B-2.~ SEGMENTS WITH INADEQUATE ACQUISITIONS 


Segment 

Error 

Missing growth stages* 

Type 1 

Type 2 

1604 

12 

16 

b, e 

1635 

1 

3 

b, c, f, g 

1648 


4 

a, b 

1661 


4 

b, c 


*Codes for growth stages are as follows: 
a = Planting through emergence 
b = Postplanting, postemergence 
c = Postemergence, tillering 
e = Tillering through heading 
f = Turning, ripen 
g = Harvest 


5-6 








TABLE B-3.- LOW-ERROR SEGMENTS 


Segment 

Error 

Growth stages present* 

Type 1 

Type 2 

1622 

1 

5 

a, b, e 

1637 

3 

5 

a, b, e 

1640 

0 

4 

a, c, e 

1663 

1 

4 

a, b, e 

1903 



b, e 

1927 

3 

1 

b, c, e 


*Codes for crop growth stages are as follows: 
a = Planting through emergence 
b = Postplanting, postemergence 
c = Postemergence, tillering 
e = Tillering through heading 
f = Turning, ripen 
g = Harvest 








TABLE B-4.- GENERALIZED DESCRIPTION OF ERRORS 


Parameter 

Percentage 

Type 1 

Type 2 

Labeled pixels in strip/fallow^ . . . 

3.2 

4.2 

Strip/ fallow fields with integrated 
signatures 

1.5 

1.6 

Pixels in integrated strip/fallow 
fields labeled other 

0.7 

0.8 

Error of all pixels labeled 

14.7 

14.1 

All labeled pixels misregistered 
in AA tape ground truth 

9.1 

11.7 

All labeled pixels mislabeled 

on AA ground- truth overlay 

0.7 

1.0 

All labeled pixels that are 
border/edge 

5.4 

11.8 


®The number of segments affected is four. 







TABLE B-5.- EXPLANATION OF COMMISSION ERRORS AND IDLE CROPLAND/FALLOW ERRORS 



Percentage 

Parameter 

Type 1 

Type 2 

All labeled commission errors 
as to crop identification: 



Idle cropland/fallow 

9.1 

33.3 

Flax 

5.0 

7.0 

All other crops, each^ 

5.0 

3.3 

Cause of error for all idle 
cropland/fallow: 



Border/edge 

50.0 

40.0 

Inconsistency (analyst labeling). . 

50.0 

30.0 

Inadequate acquisitions 

r— — 

20.0 

Abnormal signatures 


10.0 


^Pasture, grass, hay, millet, sunflowers, homestead, 
alfalfa, spring wheat/strip fallow, sugar beets. 

“Sample population of 10 pixels. 


t' 
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APPENDIX C 

HISTORICAL ACREAGE STATISTICS ON NORTH DAKOTA'S 
18 BLIND SITES, BY YEAR 


APPENDIX C 


HISTORICAL ACREAGE STATISTICS ON NORTH DAKOTA'S 
18 BLIND SITES, BY YEAR 

Specific crop acreages for the 18 blind sites during the 5-year period from 
1972 to 1976 are given in this appendix for small grains as a whole, all wheat, 
spring wheat, durum, barley, and oats. See table C-% (a) to (f). 




'•ng page 


blank sot mm; 



TABLE C-1.— Continued, 
(b) All wheat. 














TABLE C-1.— Continued 



Ward 165 000 163 000 ?14 000 211 000 256 300 252 500 277 400 267 400 271 800 267 200 




















TABLE C-1.— Continued. 












TABLE C-7 Concluded, 
(f) Oats. 



43 800 40 200 38 500 I 37 200 






















APPENDIX D 

ACQUISITION AND FIELD RECORD OF SPECTRAL SIGNATURES 


APPENDIX D 


ACQUISITION AND FIELD RECORD OF SPECTRAL SIGNATURES 

Field signatures on specific acquisitions are described for the 18 blind 
sites: 1602, 1604, 1606, 1616, 1619, 1622, 1625, 1635, 1637, 1640, 1648, 

1652, 1661, 1663, 1899, 1903, 1913, and 1927. The dates (Julian and calendar) 
and the field numbers for barley, oats, spring wheat, winter wheat, durum, 
and fallow (B, 0, SW, WW, DU, and F, respectively), are given in the following 
forms . 


PAGE BLANK 


not filmed 
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Segment 1602 





7143 SW Pink; partial emergence typical of spring wheat 

(5/21/77) signature 

B 27C Same partial emergence as for SW258 

SW 4C" Same as for SW258 

0 3“7 Pre-emergence; green signature 

7179 Clouds and haze influenced signatures 

(6/28/77) All spring grain signatures the same red 

7198 SW 25<^ Bright red; typical spring grain signature 

(7/17/77) g 275 Brighter red than for SW258 

B 161 Bright pink; unique signature 

SW 4C7 Same red as for SW258 

0 347 Red signature same as for SW258 

SW 235 Same as for 0347 

GENERAL: 

1. Separation hindered by small amount of barley 
in segment 

2. Oats' signature same as spring wheat's 


3. Barley seemingly brighter and pinker than 
other spring small grains 







Segment 1606 


Date 

Crop 

Field 

Comments 

7125 

(5/5/77) 



Pre-emergence 

7143 

(5/23/77 



Pre-emergence 

7179 

(6/28/77) 



Clouds and haze 

7197 

SW 

97 

Bright red 

(7/16/77) 

1 

0 

4 

Bright red same as SW97 


B 

198 

Mottled green/gold/red 


B 

280 

Pink (different from all other small grain fields) 


B 

102 

Brownish red (turning) signature 


SW 

60 

Eastern portion of this field same as B102 j 


SW 

301 

Same as SW97 


0 

211 

Brownish green same as an unnumbered spring wheat 
field in northern part of segment 

7250 



Harvested 

(9/7/77) 



GENERAL: 




1. Spring small grains not visually separable 




2. Wheat’ the same as some oats and other oat 



1 

fields the same as barley 

j 

i 





Segment 1616 


Date 

Crop 

Field 



Comments 

mzmz3 

(5/2,3/77) 

7140 

(5/20/77) 



Pre-emergence 

Clouds 

7141 

(5/21/77) 

7158 

(6/7/77) 



Partial emergence 
Consecutive-day coverage 

7159 

B 

89 

Bright red signature 

(6/8/77) 

SW 

28 

Bright red signature 


SW 

70 

Bright red signature 


SW 

21 

Mottled gray signature; just emerging 


B 

153 

Mottled gray signature; just emerging 


B 

108 

Mottled red signature 

7230 

(8/18/77) 

SW 

49 

Mottled red signature 
Harvested 

GENERAL: Wheat and barley unseparable 
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Segment 1619 


Date 

Crop 

Field 

Comments 

7122 

(5/2/77) 



Pre-emergence 

7140 

SW 

68 

Red lavender emergence 

(5/20/77) 

B 

214 

Red lavender emergence 


SW 

302 

Red lavender emergence 


B 

202 

Red lavender emergence 


SW 

83 

Redder signature than fields 68, 214, 302, and 202 


SW 

*91 

Bright red signature 


B 

210 

Bright red signature 


SW 

307 

Mottled red signature 


0 

182 

Light green; different from other emerged spring 
grains but similar to nonemerged small grain 
signatures 

GENERAL: 

1. Signature showing various stages of emergence 

2. No distinctive signature for any of the small 
grains 

7158 

SW 

68 

Bright red signature 

(6/7/77) 

B 

214 

Bright red signature 


SW 

307 

Bright red signature 


0 

182 

Bright red signature 


SW 

83 

Red signature 


B 

186 

Red signature 


SW 

36 

Red signature 


SW 

30^’ 

Red signature 


B 

202 

Red signature 


SW 

91 

Red signature 

*Southwest 

B 

210 

Red signature 


/ / 



Segment 1619.— Concluded. 


I 


Date 

Crop 

Field 

Comments 

7175 

SW 

68 

GENERAL: 

1. All small grains emerged 

2. No distinction between spring wheat, barley, 
or oats 

Bright red signature 


SW 

83 

Red signature 


SW 

91 

Red signature 


B 

210 

Red signature 


SW 

307 

Red signature 


SW 

36 

Bright red signature 


B 

186 

Bright red signature 


B 

214 

Darker red than field SW68 


SW 

302 

Red signature; beginning to turn 


B 

202 

Lighter red than field SW302 


0 

182 

Red signature but more lavender red than the 


SW 

27 

majority of spring wheat fields 

Red signature but more lavender red than the 

7176 

7230 



majority of spring wheat fields 

GENERAL: 

1. Spring wheat headed with some turning taking 
place 

2. All spring wheat signatures bright reds to 
red and yellow mottled signatures 

3. Barley and oat signatures very similar to 
spring wheat signatures 

4. No visual separation in small grains 

Clouds 

Harvested 
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Segment 1622 


Date 

Crop 

Field 

Comments 

7122 

(5/22/77) 



Pre-emergence 

7140/7141 

B 

88 

Emerging signatures 

(5/20,21/77) 

SW 

21 

Emerging signatures 


SW 

300 

Emerging signatures 


SW 

301 

Emerging signatures 

7159 

B 

*88 

Bright red 

(6/8/77) 

SW 

29 

Bright red 


SW 

308 

Bright red 


SW 

4 

Bright red 


SW 

310 

Bright red 


B 

106 

Light red 


B 

95 

Light red 


B 

101 

Light red 


SW 

312 

Red 


SW 

34 

Red 


SW 

37 

Red 


SW 

305 

Red 


B 

108 

Not emerged 

7176 

SW 

13 

Red 

(6/25/77) 

SW 

14 

Red 


SW 

25 

Red 


SW 

**34 

Red 


SW 

308 

Red 


B 

88 

Mottled reddish signatures 


B 

108 

Mottled reddish signatures 


SW 

300 

Mottled reddish signatures 


SW 

301 

Mottled reddish signatures 

^Eastern 

♦♦West 

B 

106 

Mottled reddish signatures 
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k 





Date 


Crop Field 


Comments 


7230 

(8/18/77) 


B 105 Mottled reddish signatures 

SW 311 Mottled reddish signatures 

0 171 Mottled reddish signatures 

0 174 Beginning to emerge 

SW 30 Emerging 

Harvest 

GENERAL: No visual separation between the grains 






Segment 1625 



Crop 

Field 

Comments 

7125 

(5/5/77) 



Pre-emergence 

7143 

(5/23/77^ 

0 

277 

Haze influenced 

1 

Light red, almost light brown, similar to SW303 


sw 

303 

Light red mixed with light brown 


sw 

312 

Light green, much of other spring wheat similar 
to this signature 


B 

92 

Mottled red and brighter browns 

7179 

(6/28/77' 

0 

277 

Light red to light brown similar to SW216 


SW 

303 

Bright red; major spring wheat signature at this date 


SW 

305 

Bright red; major spring wheat signature at this date 


SW 

312 

Mottled red not as solid as SW303 


SW 

312 

Mottled red not as solid as SW303 


B 

92 

Brighter light red than other spring grains but 
similar to some spring grain strip fields 

7197 

(7/16/77) 



Cloud covered 

7233 

(8/21/77' 



Small grains showing harvest 
GENERAL: 

1. Small amount of spring grains in segment 

2. Date 7179 only possible separation date 




a. Barley brighter than spring wheat 

b. Oats similar to some spring wheat 




3. Separation made difficult by strip fields 
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Segment 1635 


Date 

Crop 

Field 

Comments 

7105 

(4/15/77) 

7123 

(5/3/77) 

7159 

(6/8/77) 

SW 

141 

Pre-emergence 

Pre-emergence 

Strongest field with major red signature for spring 
wheat 

GENERAL : 

1. Almost no spring grains other than spring wheat 

2. Spring grains small strips 

3. All spring grains -he same red signature 
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1 






Segment 1637 


Date 

Crop 

Field 

Comments 

7123 

(5/3/77) 



Pre-emergence 

7140 

(5/20/77) 

B 

185 

Barley fields emerging; same light red signature 
as emerging spring wheat fields and early-planted 
oat fields 


SW 

*15 

Barley fields emerging; same light red signature 
as emerging spring wheat fields and early-planted 
oat fields 


B 

174 

Barley fields emerging; same light red signature 
as emerging spring wheat fields and early-planted 
oat fields 


0 

196 

Barley fields emerging; same light red signature 
as emerging spring wheat fields and early-planted 
oat fields 

7159 

(6/8/77) 

B 

185 

Cloud coverage on 40 percent of segment 


DU 

80 

Bright red signature 


SW 

15 

Bright red signature 


B 

174 

Bright red signature 


SW 

31 

Bright red signature 


SW 

26 

Dull red signature 


SW 

4 

Dull red signature 


B 

180 

Dull red signature 


B 

175 

Dull red signature 

7194 

(7/13/77) 



Clouds and haze; signatures not distinctive 

7248 

(9/5/77) 



Harvested 




GENERAL: 




1. Interpretation hindered by clouds and haze 

*Not'thern 



2. Spring grains not visually separable 
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Segment 1640 


Date 

Crop 

Field 

Comments 

7121/7122 

(5/1,2/77) 



P.re-emergence 

7139 

(5/19/77) 



Haze 

7140 

B 

163 

Pinkish red 

(5/20/77) 

B 

93 

Pinkish red 


B 

452 

Pinkish red 


SW 

427 

Pinkish red 


SW 

301 

Lavender signature, emerging fields 


B 

137 

Lavender signature, emerging fields 


0 

12 

Lavender signature, emerging fields 


6 

206 

Green, not emerged 


SW 

199 

Green, not emerged 

7175 

B 

137 

Bright red signature 

(6/24/77) 

SW 

311 

Bright red signature 


0 

12 

Bright red signature 


SW 

306 

Red signature 


B 

8 

Red signature 


B 

208 

Red signature 


SW 

302 

Red signature 


SW 

180 

Mottled brown and red; probably a poor stand 


B 

137 

Mottled pink and gold signature 

7193 

6 

208 

Harvested 

(7/12/77) 

SW 

311 

Bright red signature 


SW 

302 

Bright red signature 


0 

12 

Bright red signature 


B 

341 

Bright red signature 
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f 


Segment 1640.- Concluded. 


Date 

Crop 

Field 

Comments 


6 

299 

Ripe signature 


SW 

306 

Dull red signature 


SW 

336 

Dull red signature 


0 

397 

Dull red signature 

7194 

(7/13/77) 

B 

432 

Dull red signature 
Clouds and haze 

7211 

B 

137 

Harvested 

(7/30/77) 

0 

12 

Harvested 


B 

478 

Harvested 


0 

95 

Harvested 


SW 

375 

Ripe 


SW 

306 

Ripe 


SW 

86 

Ripe 

7229 

(8/17/77) 

B 

1 

i 

1 

1 

486 

Ripe 

Harvested 

GENERAL: 

1. 7211 - most probable date for possible separa- 
tion 

2. 7211 — date that most barley and some oat 
fields are harvested 
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Segment 1648 


Date 

Crop 

Field 

Comments 

7107 

(4/17/77) 

7125 

(5/5/77) 

7143 

(5/23/77) 

7179 

(6/28/77) 



Pre-emergence for spring wheat; winter wheat not 
separable from fields destined to be spring wheat 

Pre-emergence for spring wheat; winter wheat 
signatures green to pink 

Haze and data dropout 

Small grain fields; red signature to an integrated 
red signature (field boundaries not apparent) 

GENERAL: 

1. Nearly all small grains in strip fallow fields 

2. No visual separation apparent between winter 
wheat, spring wheat, barley, and oats 

3. Problems identifying small grains because of 
narrow strip fields 
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Pre-emergence 


7143 

(5/P3/77) 

7179 SW 
(6/27/77) 


SW/F/ 215 
0/C ' 


7197 

(7/16/77) 


SW/F 79 

SW/F 222 

SW/F/ 215 

0/C 

SW 81 

SW 83 


7233 

(8/21/77) 


Pre-emergence 

Bright red signature 

Bright red signature 

Strip fields; pink signature 

Strip fields; pink signature 

Mottled signature; integrated fields 
boundaries not discernible 

Mottled signature; integrated fields 
boundaries not discernible 


SW 310 Dull red signature 


Mottled red/green-gold signature 
Mottled green/gold signature 
Green signature 
Green signature 

Bright red signature 
Dull red ^.ignature 
Harvested 
Harvested 
Harvested 

GENERAL: 

1 . Very little barley 

2. Strip/fallow fields 


3. No separation 





Segment 1661 


Date Crop Field Comments 

7123 Pre-emergence 

(5/3/77) 

7159 B 134 Same red signature as SW40 but not as bright as SW135 

(6/8/77) signature 

SW 135 Bright red signature typical of spring wheat 

SW 307 Bright red signature typical of spring wheat 

246 0 S'ime red as SW307 

GENERAL: 

1. Small amount of spring grain other than spring 
wheat 

2. Identification of spring grains difficult 
because of strip fields 

3. No visual separation 







Date 


Crop Field 


Comments 


7120 

(4/30/77) 



Pre-emergence 

7121 

(5/1/77) 

SW 

59 

Pre-emergence 

7138 

SW 

22 

Bright red; fully emerged 

(5/18/77) 

B 

142 

Bright red; fully emerged 


B 

140 

Bright red; fully emerged 


SW 

13 

Dark red 


B 

141 

Brighter red than other signatures 


SW 

300 

Mottled green 


0 

194 

Mottled green 


B 

129 

Mottled green 

7139 

(5/19/77) 



Haze over segment 

7156 

SW 

22 

Solid dark red 

(6/5/77) 

SW 

13 

Solid dark red 


B 

142 

Solid dark red 


G 

194 

Solid dark red 


SW 

300 

Solid dark red 


SW 

59 

Solid dark red 


0 

207 

Solid dark red 


B 

158 

Solid dark red 


B 

141 

Brightest red signature 


B 

140 

Bright red 


B 

129 

Bright red 

7157 

(6/6/77) 



No change from 7156 








Segment 1663.- Continued. 


Date 

Crop 

Field 

Comments 

7174 

(6/23/77) 

SW 

22 

Mottled red 


SW 

13 

Mottled red; brown turning signature 


B 

142 

Mottled red; brown turning signature 


B 

140 

Mottled red; brown turning signature 


B 

141 

Light red/yellow 


0 

194 

Solid red 


B 

129 

Solid red 


SW 

53 

Solid red 


SW 

300 

Dark red 


0 

207 

Dark red 


SW 

59 

Dark red 


B 

158 

Light green; ripe or harvest 

7175 

(6/24/77) 



No change from 7174 

7193 

B 

142 

Green; mature or harvest 

(7/12/77) 

SW 

22 

Green; mature or harvest 


B 

141 

Green; mature or harvest 


0 

207 

Green; mature or harvest 


SW 

13 

Red/yellow; mature 


B 

129 

Dark green; plowed 


B 

158 

Dark green; plowed 


SW 

300 

Dark brown; ripe 


0 

207 

Dark brown; ripe 

7211 

(7/30/77) 

SW 

22 

Dark green; plowed 


SW 

13 

Dark green; plowed 


B 

142 

Dark green; plowed 


0 

194 

Bright light green; harvest 


i 
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Segment 1663. - Concluded. 


Date 

Crop 

Field 

Comments 

7229 

(8/17/77) 

B 

B 

129 

123 

Bright light green; harvest 
Bright light green; harvest 

Spring grain harvested 

GENERAL: 

1. Tendency for barley to be brighter 
on date 7156 

2. Some barley same all through 

3. No oats separation 

4. Possible separation 7156 
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Segment 1899 


Date 

Crop 

Field 

Comments 

IB9I 



Pre-emergence 

7140 

B 

129 

Emerging pink/lavender signature 

(5/20/77) 

SW 

306 

Emerging pink/lavender signature 


B 

276 

Emerging pink/lavender signature 


SW 

275 

Emerging pink/ lavender signature 

7157 

B 

276 

Bright red signature 

(6/6/77) 

B 

261 

Bright red signature 


B 

285 

Dull red 


SW 

306 

Dull red 


SW 

275 

Dull red 


SW 

301 

Red signature 


B 

6 

Red signature 


B 

129 

Red signature 


SW 

175 

Red signature 


SW 

307 

Mottled lavender 


B 

61 

Mottled lavender 


B 

79 

Red signature 

7175 

SW 

32 

Mottled red, orange, brownish red 

(6/24/77) 

B 

28 

Mottled red, orange, brownish red 


SW 

306 

Mottled red, orange, brownish red 


B 

61 

Mottled red, orange, brownish red 


SW 

307 

Mottled red, orange, brownish red 


SW 

275 

Mottled red, orange, brownish red 


B 

279 

Mottled red, orange, brownish red 


B 

272 

Slightly brighter than B279 

GENERAL: little visual difference in small -grain 

signatures on this acquisition 






Comments 


Dark red, brownish red 
Dark red, brownish red 

I 

Dark red, brownish red 
Dark red, brownish red 
Dark red, brownish red 
Dull red 
I Dull red 
'Ripe 
Ri pe 
Ripe 

Nearly ripe 
GLNERAL: 

! 

1. 7193 best date for separation 

2 . Good field sizes in segment 






Segment 1903 


Date Crop Field 


Comments 


1 


125 

5/77) 


7179 

(6/28/77) 


7196 

(7/15/77) 

7197 

(7/16/77) 


7233 

(8/21/77) 



Pre-emergence 


Bright red typical spring grain signature 
Bright red typical spring grain signature 
bright red typical spring grain signature 
Bright pink 

Bright red same as SW73 
Red similar to SW104 

Cloud cover over 40 percent 


28 Dark red turning signature 

73 Dark red turning signature 

104 Mottled red/brown 

49 Mottled red/brown 

411 Bright pink; small amount on segment 

208 Mottled red/brown similar to SW49 and SW104 
320 Dark red similar to SW28 


Spring grains harvested 
GENERAL: 

1 . Very 1 i ttle barley 


2. Barley signatures similar to spring wheat 








Segment 1913 


te 


Crop 


Field 


Comments 


H25 

.-/5/77) 
7143 

(5/23/77) 


7161 

(6/10/77) 


7179 

{mwD 


sw 

sw 

0 

sw 

0 

sw 

sw 

0 

sw 

ww 

0 

SW/F 

sw 

sw 

0 

ww 

0 

sw 

B/F 


266 

159 

158 

250 

251 

266 

159 
158 

250 
133 

251 
47 

266 

250 

251 
133 

158 

159 
263 


Pre-emergence 

Lavender; partial emergence 
Light brown 

Light brown; same as spring wheat 
Green; pre-emergence 
Mottled red/lavender 

Red mottled with lavender 

Light red/brown 

Light red/brown 

Red mottled with bright pixels 

Bright red 

Bright red similar to WW133 
Bright pink like SW42 

Bright red typical of most small grains 

Bright red typical of most small grains 

Bright red typical of most small grains 

Bright red typical of most small grains 

Mottled Ved/brown 

Light red 

Red; same as SW309 


719/ SW 266 Dark red turning signature 
(7/16/77) ,,, . . . 

SW 159 Dark red turning signature 

SW 250 Dark red turning signature 

WW 133 Red/brown turning 

SW 162 Red/brown turning 

0 158 Red/brown turning 

0 251 Bright light green harvest signature 

SW 309 Bright red 






Segment 1913.- Concluded. 


Date 

Crop 

Field 

Comments 

7215 

(8/3/77) 

7233 

(8/21/77) 

B/F 

SW 

SW 

0 

SW 

0 

SW 

B/F 

263 

266 

159 

251 

250 

158 

133 

263 

Bright red 

Brown/yellow; ripe signature; ripe looking 

Brown/yellow; ripe signature; ripe looking 

Brown/yellow; ripe signature; ripe looking 

Brown/yellow; ripe signature; ripe looking 

Yellow, ripe to harvest; similar to SW78 
Bright yellow; ripe signature 
Barley same as SW314 brown-yellow 

Cloud and haze cover 

GENERAL: 

1. Small amount of barley 

2. Oat fields the same as other spring grains 
throughout growing season 

3. No separation 


D-27 


/■rr. 



Segment 1927 


Date 

Crop 

Field 

Comments 

7121/7122 

(5/1.2/77) 


i 

1 

Pre-emergence 

7140 

SW 

18 

Red lavender signature 

(5/20/77) 

SW 

*103 

Red lavender signature 


B 

179 

Red 


B 

41 

Bright red 


SW 

72 

Lavender 


B 

26 

Lavender 


SW 

**82 

Dark green; not emerged 


B 

46 

Dark green; not emerged 

7157/7158 

(6/6,7/77) 

SW 

72 

Bright red 


B 

26 

Bright red 


B 

32 

Bright red 


B 

38 

Bright red 


0 

148 

Bright red 


SW 

103 

Red/pink red 


SW 

***18 

Red/ pink red 


SW 

82 

Red/pink red 


B 

27 

Bright pink 

7175/7176 

B 

32 

Red signature 

(6/24,25/77) 

1 

0 

29 

Rod signature 

j 

1 

B 

27 

Red signature 


B 

26 

Red signature 


SW 

72 

Red signature 


SW 

103 

Red signature 

7193/7194 

B 

26 

Green/brown 

(7/12,13/77) 

SW 

72 

Groen/brown 

■^'./estern 

**Eastern 

SW 

18 

Green; ripe 

***Southern 





D-2R 








Segment 1^27.— Concluded. 


Date 

Crop 

Field 

Comments 


0 

114 

Green/ brown 


SW 

301 

Green/brown 


B 

38 

Green/ brown 


SW 

103 

Mottled green/brown/ red 


0 

28 

Dull red 


B 

212 

Harvested 


6 

38 

Harvested 

7230 

(8/18/77) 

B 

41 

Harvested 

Harvest 

GENERAL: Most visual separation 


on 7193-7194 dates 


D-29 








